Training procedure
Framework versions
- PEFT 0.4.0
{'eval_loss': 1.0666293746908195e-05, 'eval_runtime': 11898.68, 'eval_samples_per_second': 2.641, 'eval_steps_per_second': 0.33, 'epoch': 1.0} {'train_runtime': 25159.3445, 'train_samples_per_second': 0.535, 'train_steps_per_second': 0.013, 'train_loss': 0.033493353224400835, 'epoch': 1.0} 100%|βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ| 336/336 [6:59:18<00:00, 74.88s/it] [2024-08-22 13:47:25,207] [INFO] [launch.py:347:main] Process 25359 exits successfully. [2024-08-22 13:47:26,209] [INFO] [launch.py:347:main] Process 25360 exits successfully. [2024-08-22 13:47:26,209] [INFO] [launch.py:347:main] Process 25361 exits successfully. wandb: | 0.033 MB of 0.044 MB uploaded wandb: Run history: wandb: eval/loss β wandb: eval/runtime β wandb: eval/samples_per_second β wandb: eval/steps_per_second β wandb: train/epoch βββββββββββββββββββββ β β β β β ββββββββββββββ wandb: train/global_step βββββββββββββββββββββ β β β β β ββββββββββββββ wandb: train/learning_rate ββββββββββββββββββ β β β βββββββββββββββββββ wandb: train/loss ββββββββββββββββββββββββββββββββββββββββ wandb: train/total_flos β wandb: train/train_loss β wandb: train/train_runtime β wandb: train/train_samples_per_second β wandb: train/train_steps_per_second β wandb: wandb: Run summary: wandb: eval/loss 1e-05 wandb: eval/runtime 11898.68 wandb: eval/samples_per_second 2.641 wandb: eval/steps_per_second 0.33 wandb: train/epoch 1.0 wandb: train/global_step 336 wandb: train/learning_rate 0.0 wandb: train/loss 0.0 wandb: train/total_flos 653027262332928.0 wandb: train/train_loss 0.03349 wandb: train/train_runtime 25159.3445 wandb: train/train_samples_per_second 0.535 wandb: train/train_steps_per_second 0.013 wandb: wandb: π View run ethereal-lion-28 at: https://wandb.ai/pomichterstash-massachusetts-institute-of-technology/huggingface/runs/9dtkzox9 wandb: βοΈ View project at: https://wandb.ai/pomichterstash-massachusetts-institute-of-technology/huggingface wandb: Synced 5 W&B file(s), 0 media file(s), 2 artifact file(s) and 0 other file(s) wandb: Find logs at: ./wandb/run-20240822_064756-9dtkzox9/logs
- Downloads last month
- 3