AUB MIND LAB
commited on
Commit
•
1b3a0ef
1
Parent(s):
612594b
Update README.md
Browse files
README.md
CHANGED
@@ -109,7 +109,7 @@ All models are available in the `HuggingFace` model page under the [aubmindlab](
|
|
109 |
Model | Hardware | num of examples (seq len = 1024) | Batch Size | Num of Steps | Time (in days)
|
110 |
---|:---:|:---:|:---:|:---:|:---:
|
111 |
AraGPT2-base | TPUv3-128 | 9.7M | 1792 | 125K | 1.5
|
112 |
-
AraGPT2-medium | TPUv3-8 | 9.7M |
|
113 |
AraGPT2-large | TPUv3-128 | 9.7M | 256 | 220k | 3
|
114 |
AraGPT2-mega | TPUv3-128 | 9.7M | 256 | 780K | 9
|
115 |
|
|
|
109 |
Model | Hardware | num of examples (seq len = 1024) | Batch Size | Num of Steps | Time (in days)
|
110 |
---|:---:|:---:|:---:|:---:|:---:
|
111 |
AraGPT2-base | TPUv3-128 | 9.7M | 1792 | 125K | 1.5
|
112 |
+
AraGPT2-medium | TPUv3-8 | 9.7M | 80 | 1M | 15
|
113 |
AraGPT2-large | TPUv3-128 | 9.7M | 256 | 220k | 3
|
114 |
AraGPT2-mega | TPUv3-128 | 9.7M | 256 | 780K | 9
|
115 |
|