Configurations choice
Collection
Choice of configuration based on the results of different fine-tuning. All provide mor or less same results but 1 and 2 are way faster! (lr)
•
52 items
•
Updated
This model is a fine-tuned version of meta-llama/Meta-Llama-3.1-8B-Instruct on the GaetanMichelet/chat-60_ft_task-2 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
Training Loss | Epoch | Step | Validation Loss |
---|---|---|---|
1.0749 | 0.6957 | 2 | 1.0893 |
1.0585 | 1.7391 | 5 | 1.0147 |
0.935 | 2.7826 | 8 | 0.8862 |
0.8267 | 3.8261 | 11 | 0.8299 |
0.7982 | 4.8696 | 14 | 0.7848 |
0.7295 | 5.9130 | 17 | 0.7512 |
0.7036 | 6.9565 | 20 | 0.7342 |
0.6598 | 8.0 | 23 | 0.7226 |
0.6493 | 8.6957 | 25 | 0.7157 |
0.5819 | 9.7391 | 28 | 0.7086 |
0.5695 | 10.7826 | 31 | 0.7087 |
0.5157 | 11.8261 | 34 | 0.7257 |
0.4755 | 12.8696 | 37 | 0.7442 |
0.4184 | 13.9130 | 40 | 0.7554 |
0.3399 | 14.9565 | 43 | 0.8076 |
0.2958 | 16.0 | 46 | 0.8420 |
0.2339 | 16.6957 | 48 | 0.9179 |
Base model
meta-llama/Llama-3.1-8B