slm-experiments
Collection
15 items
•
Updated
This model is a fine-tuned version of HuggingFaceTB/SmolLM-1.7B-Instruct on the generator dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
Training Loss | Epoch | Step | Validation Loss |
---|---|---|---|
2.0516 | 0.9756 | 10 | 1.8985 |
1.8456 | 1.9512 | 20 | 1.7876 |
1.7672 | 2.9268 | 30 | 1.7327 |
1.712 | 4.0 | 41 | 1.6967 |
1.6874 | 4.9756 | 51 | 1.6761 |
1.6643 | 5.9512 | 61 | 1.6636 |
1.6426 | 6.9268 | 71 | 1.6565 |
1.6388 | 8.0 | 82 | 1.6530 |
1.6387 | 8.9756 | 92 | 1.6524 |
1.6343 | 9.7561 | 100 | 1.6524 |
Base model
HuggingFaceTB/SmolLM-1.7B