Update README.md
Browse files
README.md
CHANGED
|
@@ -18,7 +18,7 @@ Trained on HuggingFace C4 dataset
|
|
| 18 |
|
| 19 |
## Training procedure
|
| 20 |
|
| 21 |
-
This model was trained on C4 for ~2.5B tokens. Training time was ~
|
| 22 |
|
| 23 |
## Intended Use and Limitations
|
| 24 |
|
|
|
|
| 18 |
|
| 19 |
## Training procedure
|
| 20 |
|
| 21 |
+
This model was trained on C4 for ~2.5B tokens. Training time was ~1 hour with 104 A100-40gb GPUs.
|
| 22 |
|
| 23 |
## Intended Use and Limitations
|
| 24 |
|