Update README.md
Browse files
README.md
CHANGED
@@ -33,7 +33,7 @@ img {
|
|
33 |
|
34 |
## Model Details
|
35 |
|
36 |
-
Palmyra Large was primarily pre-trained with English text. Note that there is still a trace amount of non-English data present within the training corpus that was accessed through CommonCrawl. A causal language modeling (CLM) objective was utilized during the process of the model's pretraining. Similar to GPT-3, Palmyra Large is a member of the same family of models that only contain a decoder. As a result, it was pre-trained utilizing the objective of self-supervised causal language modeling.
|
37 |
|
38 |
### Model Description
|
39 |
|
|
|
33 |
|
34 |
## Model Details
|
35 |
|
36 |
+
Palmyra Large was primarily pre-trained with English text. Note that there is still a trace amount of non-English data present within the training corpus that was accessed through CommonCrawl. A causal language modeling (CLM) objective was utilized during the process of the model's pretraining. Similar to GPT-3, Palmyra Large is a member of the same family of models that only contain a decoder. As a result, it was pre-trained utilizing the objective of self-supervised causal language modeling.
|
37 |
|
38 |
### Model Description
|
39 |
|