Update README.md
Browse files
README.md
CHANGED
@@ -55,7 +55,7 @@ widget:
|
|
55 |
|
56 |
## Model description
|
57 |
|
58 |
-
**GPT2-base-bne** is a transformer-based model for the Spanish language. It is based on the [GPT-2](
|
59 |
|
60 |
|
61 |
## Intended uses and limitations
|
|
|
55 |
|
56 |
## Model description
|
57 |
|
58 |
+
**GPT2-base-bne** is a transformer-based model for the Spanish language. It is based on the [GPT-2](https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf) model and has been pre-trained using the largest Spanish corpus known to date, with a total of 570GB of clean and deduplicated text processed for this work, compiled from the web crawlings performed by the [National Library of Spain (Biblioteca Nacional de España)](http://www.bne.es/en/Inicio/index.html) from 2009 to 2019.
|
59 |
|
60 |
|
61 |
## Intended uses and limitations
|