add finetuning recipe
Browse files
README.md
CHANGED
|
@@ -96,6 +96,9 @@ We train the models using the [alignment-handbook](https://github.com/huggingfac
|
|
| 96 |
- warmup ratio 0.1
|
| 97 |
- global batch size 262k tokens
|
| 98 |
|
|
|
|
|
|
|
|
|
|
| 99 |
# Citation
|
| 100 |
```bash
|
| 101 |
@misc{allal2024SmolLM,
|
|
|
|
| 96 |
- warmup ratio 0.1
|
| 97 |
- global batch size 262k tokens
|
| 98 |
|
| 99 |
+
You can find the training recipe here: https://github.com/huggingface/alignment-handbook/tree/smollm/recipes/smollm
|
| 100 |
+
|
| 101 |
+
|
| 102 |
# Citation
|
| 103 |
```bash
|
| 104 |
@misc{allal2024SmolLM,
|