Update README.md
Browse files
README.md
CHANGED
|
@@ -90,6 +90,8 @@ We train the models using the [alignment-handbook](https://github.com/huggingfac
|
|
| 90 |
- warmup ratio 0.1
|
| 91 |
- global batch size 262k tokens
|
| 92 |
|
|
|
|
|
|
|
| 93 |
# Citation
|
| 94 |
```bash
|
| 95 |
@misc{allal2024SmolLM,
|
|
|
|
| 90 |
- warmup ratio 0.1
|
| 91 |
- global batch size 262k tokens
|
| 92 |
|
| 93 |
+
You can find the training recipe here: https://github.com/huggingface/alignment-handbook/tree/smollm/recipes/smollm
|
| 94 |
+
|
| 95 |
# Citation
|
| 96 |
```bash
|
| 97 |
@misc{allal2024SmolLM,
|