ibm-granite
/

granite-3.0-2b-base

Text Generation

Model card Files Files and versions Community

amezasor commited on 14 days ago

Commit

d39082d

•

1 Parent(s): 3661276

typo fix

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -271,7 +271,7 @@ Granite-3.0-2B-Base is based on a decoder-only dense transformer architecture. C
 | Initialization std           | **0.1**      | 0.1      | 0.1      | 0.1      |
 | Sequence Length              | **4096**     | 4096     | 4096     | 4096     |
 | Position Embedding           | **RoPE**     | RoPE     | RoPE     | RoPE     |
-| # Paremeters                 | **2.5B**     | 8.1B     | 1.3B     | 3.3B     |
 | # Active Parameters          | **2.5B**     | 8.1B     | 400M     | 800M     |
 | # Training tokens            | **12T**      | 12T      | 10T      | 10T      |

 | Initialization std           | **0.1**      | 0.1      | 0.1      | 0.1      |
 | Sequence Length              | **4096**     | 4096     | 4096     | 4096     |
 | Position Embedding           | **RoPE**     | RoPE     | RoPE     | RoPE     |
+| # Parameters                 | **2.5B**     | 8.1B     | 1.3B     | 3.3B     |
 | # Active Parameters          | **2.5B**     | 8.1B     | 400M     | 800M     |
 | # Training tokens            | **12T**      | 12T      | 10T      | 10T      |