TRI-ML
/

DCLM-1B-IT

achal-tri commited on Jul 22

Commit

f81008b

•

1 Parent(s): 645f2d9

Update README.md

Files changed (1) hide show

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ DCLM-IT-1B is a 1.4B billion parameter language model trained on the DCLM-Baseli
 | Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
 |:------:|:-----------------:|:--------:|:-------------:|:-----------------:|:----------------:|
-| 1.4B   | 2.608T             | 24       | 2048          | 16                | 2048             |
 ### Model Description

 | Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
 |:------:|:-----------------:|:--------:|:-------------:|:-----------------:|:----------------:|
+| 1.4B   | 4.308T             | 24       | 2048          | 16                | 2048             |
 ### Model Description