task_categories:text-generation size_categories:10M<n<100M language:ru region:us
---
dataset_info:
  features:
  - name: text
    dtype: string
  splits:
  - name: train
    num_bytes: 78609111353
    num_examples: 14811026
  - name: test
    num_bytes: 397130292
    num_examples: 74794
  - name: validation
    num_bytes: 395354867
    num_examples: 74691
  download_size: 24170140196
  dataset_size: 79401596512
task_categories:
- text-generation
language:
- ru
size_categories:
- 10M<n<100M
---

# Dataset for training Russian language models

Overall: 75G

Scripts: https://github.com/IlyaGusev/rulm/tree/master/data_processing

| Website         | Char count (M) | Word count (M) |
|-----------------|---------------|---------------|
| pikabu          | 14938         | 2161          |
| lenta           | 1008          | 135           |
| stihi           | 2994          | 393           |
| stackoverflow   | 1073          | 228           |
| habr            | 5112          | 753           |
| taiga_fontanka  | 419           | 55            |
| librusec        | 10149         | 1573          |
| buriy           | 2646          | 352           |
| ods_tass        | 1908          | 255           |
| wiki            | 3473          | 469           |
| math            | 987           | 177           |



