task_categories:text-generation task_categories:fill-mask task_ids:language-modeling task_ids:masked-language-modeling size_categories:1M<n<10M language:pl license:cc-by-sa-3.0 pretraining language modelling wikipedia web region:us
---
license: cc-by-sa-3.0
dataset_info:
  features:
  - name: id
    dtype: string
  - name: url
    dtype: string
  - name: title
    dtype: string
  - name: text
    dtype: string
  splits:
  - name: train
    num_bytes: 2883878741
    num_examples: 1562327
  download_size: 1761971402
  dataset_size: 2883878741
task_categories:
  - text-generation
  - fill-mask
task_ids:
  - language-modeling
  - masked-language-modeling
language:
- pl
pretty_name: Polish Wikipedia 2023-04-01
size_categories:
- 1M<n<10M
tags:
  - pretraining
  - language modelling
  - wikipedia
  - web
---

# Dataset Card for April 2023 Polish Wikipedia

Wikipedia dataset containing cleaned articles of Polish language.
The dataset has been built from the Wikipedia dump (https://dumps.wikimedia.org/) 
using the [OLM Project](https://github.com/huggingface/olm-datasets). 
Each example contains the content of one full Wikipedia article with cleaning to strip
markdown and unwanted sections (references, etc.).


### Licensing Information

Most of Wikipedia's text and many of its images are co-licensed under the
[Creative Commons Attribution-ShareAlike 3.0 Unported License](https://en.wikipedia.org/wiki/Wikipedia:Text_of_Creative_Commons_Attribution-ShareAlike_3.0_Unported_License)
(CC BY-SA) and the [GNU Free Documentation License](https://en.wikipedia.org/wiki/Wikipedia:Text_of_the_GNU_Free_Documentation_License)
(GFDL) (unversioned, with no invariant sections, front-cover texts, or back-cover texts). 

Some text has been imported only under CC BY-SA and CC BY-SA-compatible license and cannot be reused under GFDL; such
text will be identified on the page footer, in the page history, or on the discussion page of the article that utilizes
the text.

### Citation Information

```
@ONLINE{wikidump,
    author = "Wikimedia Foundation",
    title  = "Wikimedia Downloads",
    url    = "https://dumps.wikimedia.org"
}
```