task_categories:translation annotations_creators:found language_creators:found multilinguality:translation size_categories:100K<n<1M source_datasets:original language:bg language:cs language:da language:de language:el language:en language:es language:et language:fi language:fr language:hu language:it language:lt language:lv language:nl language:pl language:pt language:ro language:sk language:sl language:sv license:unknown region:us
A parallel corpus extracted from the European Parliament web site by Philipp Koehn (University of Edinburgh). The main intended use is to aid statistical machine translation research.
---
annotations_creators:
- found
language_creators:
- found
language:
- bg
- cs
- da
- de
- el
- en
- es
- et
- fi
- fr
- hu
- it
- lt
- lv
- nl
- pl
- pt
- ro
- sk
- sl
- sv
license:
- unknown
multilinguality:
- translation
size_categories:
- 100K<n<1M
source_datasets:
- original
task_categories:
- translation
task_ids: []
paperswithcode_id: null
pretty_name: europarl-bilingual
dataset_info:
- config_name: bg-cs
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - cs
  splits:
  - name: train
    num_bytes: 175372131
    num_examples: 402657
  download_size: 77543700
  dataset_size: 175372131
- config_name: bg-da
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - da
  splits:
  - name: train
    num_bytes: 169901335
    num_examples: 393449
  download_size: 161209111
  dataset_size: 169901335
- config_name: bg-de
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - de
  splits:
  - name: train
    num_bytes: 179830695
    num_examples: 393298
  download_size: 173031810
  dataset_size: 179830695
- config_name: bg-el
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - el
  splits:
  - name: train
    num_bytes: 232659899
    num_examples: 377341
  download_size: 164911397
  dataset_size: 232659899
- config_name: bg-en
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - en
  splits:
  - name: train
    num_bytes: 175002243
    num_examples: 408290
  download_size: 175210123
  dataset_size: 175002243
- config_name: bg-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - es
  splits:
  - name: train
    num_bytes: 175608108
    num_examples: 388226
  download_size: 167299422
  dataset_size: 175608108
- config_name: bg-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - et
  splits:
  - name: train
    num_bytes: 169828337
    num_examples: 400712
  download_size: 74382173
  dataset_size: 169828337
- config_name: bg-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - fi
  splits:
  - name: train
    num_bytes: 173345926
    num_examples: 396624
  download_size: 159647184
  dataset_size: 173345926
- config_name: bg-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - fr
  splits:
  - name: train
    num_bytes: 179518097
    num_examples: 393644
  download_size: 173290519
  dataset_size: 179518097
- config_name: bg-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - hu
  splits:
  - name: train
    num_bytes: 173346636
    num_examples: 382773
  download_size: 77741287
  dataset_size: 173346636
- config_name: bg-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - it
  splits:
  - name: train
    num_bytes: 178372027
    num_examples: 377822
  download_size: 167706004
  dataset_size: 178372027
- config_name: bg-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - lt
  splits:
  - name: train
    num_bytes: 168242178
    num_examples: 392554
  download_size: 74614251
  dataset_size: 168242178
- config_name: bg-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - lv
  splits:
  - name: train
    num_bytes: 173267674
    num_examples: 398355
  download_size: 74564662
  dataset_size: 173267674
- config_name: bg-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - nl
  splits:
  - name: train
    num_bytes: 174737553
    num_examples: 388273
  download_size: 170765314
  dataset_size: 174737553
- config_name: bg-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - pl
  splits:
  - name: train
    num_bytes: 175528692
    num_examples: 395269
  download_size: 78179477
  dataset_size: 175528692
- config_name: bg-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - pt
  splits:
  - name: train
    num_bytes: 174578955
    num_examples: 388972
  download_size: 170237403
  dataset_size: 174578955
- config_name: bg-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - ro
  splits:
  - name: train
    num_bytes: 175218264
    num_examples: 389381
  download_size: 60489220
  dataset_size: 175218264
- config_name: bg-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - sk
  splits:
  - name: train
    num_bytes: 170977227
    num_examples: 393815
  download_size: 77065166
  dataset_size: 170977227
- config_name: bg-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - sl
  splits:
  - name: train
    num_bytes: 159371534
    num_examples: 380231
  download_size: 72025259
  dataset_size: 159371534
- config_name: bg-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - bg
        - sv
  splits:
  - name: train
    num_bytes: 172562375
    num_examples: 398236
  download_size: 160015782
  dataset_size: 172562375
- config_name: cs-da
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - da
  splits:
  - name: train
    num_bytes: 189814103
    num_examples: 618055
  download_size: 174829844
  dataset_size: 189814103
- config_name: cs-de
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - de
  splits:
  - name: train
    num_bytes: 187747987
    num_examples: 568589
  download_size: 186471876
  dataset_size: 187747987
- config_name: cs-el
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - el
  splits:
  - name: train
    num_bytes: 289333860
    num_examples: 599489
  download_size: 178443921
  dataset_size: 289333860
- config_name: cs-en
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - en
  splits:
  - name: train
    num_bytes: 196378085
    num_examples: 647095
  download_size: 188756690
  dataset_size: 196378085
- config_name: cs-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - es
  splits:
  - name: train
    num_bytes: 201972536
    num_examples: 619774
  download_size: 180848885
  dataset_size: 201972536
- config_name: cs-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - et
  splits:
  - name: train
    num_bytes: 189852839
    num_examples: 636512
  download_size: 87913231
  dataset_size: 189852839
- config_name: cs-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - fi
  splits:
  - name: train
    num_bytes: 193370836
    num_examples: 619320
  download_size: 173216683
  dataset_size: 193370836
- config_name: cs-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - fr
  splits:
  - name: train
    num_bytes: 207043213
    num_examples: 628200
  download_size: 186873132
  dataset_size: 207043213
- config_name: cs-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - hu
  splits:
  - name: train
    num_bytes: 201392624
    num_examples: 616160
  download_size: 91341961
  dataset_size: 201392624
- config_name: cs-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - it
  splits:
  - name: train
    num_bytes: 203150534
    num_examples: 607017
  download_size: 181266237
  dataset_size: 203150534
- config_name: cs-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - lt
  splits:
  - name: train
    num_bytes: 189504979
    num_examples: 624292
  download_size: 88260876
  dataset_size: 189504979
- config_name: cs-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - lv
  splits:
  - name: train
    num_bytes: 193888740
    num_examples: 627873
  download_size: 88126869
  dataset_size: 193888740
- config_name: cs-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - nl
  splits:
  - name: train
    num_bytes: 199512564
    num_examples: 618414
  download_size: 184381636
  dataset_size: 199512564
- config_name: cs-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - pl
  splits:
  - name: train
    num_bytes: 197967454
    num_examples: 621387
  download_size: 91806300
  dataset_size: 197967454
- config_name: cs-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - pt
  splits:
  - name: train
    num_bytes: 197178140
    num_examples: 609729
  download_size: 183745721
  dataset_size: 197178140
- config_name: cs-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - ro
  splits:
  - name: train
    num_bytes: 127321661
    num_examples: 392085
  download_size: 73245197
  dataset_size: 127321661
- config_name: cs-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - sk
  splits:
  - name: train
    num_bytes: 196186957
    num_examples: 636128
  download_size: 90623958
  dataset_size: 196186957
- config_name: cs-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - sl
  splits:
  - name: train
    num_bytes: 179909545
    num_examples: 611624
  download_size: 85558670
  dataset_size: 179909545
- config_name: cs-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - cs
        - sv
  splits:
  - name: train
    num_bytes: 194656792
    num_examples: 631544
  download_size: 173672259
  dataset_size: 194656792
- config_name: da-de
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - de
  splits:
  - name: train
    num_bytes: 624355083
    num_examples: 1928414
  download_size: 276778385
  dataset_size: 624355083
- config_name: da-el
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - el
  splits:
  - name: train
    num_bytes: 604008313
    num_examples: 1280579
  download_size: 265542591
  dataset_size: 604008313
- config_name: da-en
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - en
  splits:
  - name: train
    num_bytes: 612701093
    num_examples: 1991647
  download_size: 279497322
  dataset_size: 612701093
- config_name: da-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - es
  splits:
  - name: train
    num_bytes: 631311642
    num_examples: 1943931
  download_size: 271357896
  dataset_size: 631311642
- config_name: da-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - et
  splits:
  - name: train
    num_bytes: 182908097
    num_examples: 635018
  download_size: 171538628
  dataset_size: 182908097
- config_name: da-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - fi
  splits:
  - name: train
    num_bytes: 599820497
    num_examples: 1917260
  download_size: 263430295
  dataset_size: 599820497
- config_name: da-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - fr
  splits:
  - name: train
    num_bytes: 658108095
    num_examples: 1992590
  download_size: 277504353
  dataset_size: 658108095
- config_name: da-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - hu
  splits:
  - name: train
    num_bytes: 196114245
    num_examples: 617519
  download_size: 174981657
  dataset_size: 196114245
- config_name: da-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - it
  splits:
  - name: train
    num_bytes: 630400040
    num_examples: 1876703
  download_size: 271654671
  dataset_size: 630400040
- config_name: da-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - lt
  splits:
  - name: train
    num_bytes: 184071192
    num_examples: 614923
  download_size: 171931855
  dataset_size: 184071192
- config_name: da-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - lv
  splits:
  - name: train
    num_bytes: 188638250
    num_examples: 627809
  download_size: 171781368
  dataset_size: 188638250
- config_name: da-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - nl
  splits:
  - name: train
    num_bytes: 634339405
    num_examples: 1987498
  download_size: 275140635
  dataset_size: 634339405
- config_name: da-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - pl
  splits:
  - name: train
    num_bytes: 193218656
    num_examples: 642544
  download_size: 175344681
  dataset_size: 193218656
- config_name: da-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - pt
  splits:
  - name: train
    num_bytes: 631413013
    num_examples: 1930454
  download_size: 274286241
  dataset_size: 631413013
- config_name: da-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - ro
  splits:
  - name: train
    num_bytes: 124974166
    num_examples: 388156
  download_size: 156965207
  dataset_size: 124974166
- config_name: da-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - sk
  splits:
  - name: train
    num_bytes: 190277240
    num_examples: 621907
  download_size: 174378230
  dataset_size: 190277240
- config_name: da-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - sl
  splits:
  - name: train
    num_bytes: 173968152
    num_examples: 595944
  download_size: 169356730
  dataset_size: 173968152
- config_name: da-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - da
        - sv
  splits:
  - name: train
    num_bytes: 567189130
    num_examples: 1871171
  download_size: 263342660
  dataset_size: 567189130
- config_name: de-el
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - el
  splits:
  - name: train
    num_bytes: 603303137
    num_examples: 1223026
  download_size: 277232265
  dataset_size: 603303137
- config_name: de-en
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - en
  splits:
  - name: train
    num_bytes: 641864487
    num_examples: 1961119
  download_size: 291376506
  dataset_size: 641864487
- config_name: de-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - es
  splits:
  - name: train
    num_bytes: 651057814
    num_examples: 1887879
  download_size: 283096221
  dataset_size: 651057814
- config_name: de-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - et
  splits:
  - name: train
    num_bytes: 181554876
    num_examples: 578248
  download_size: 183218377
  dataset_size: 181554876
- config_name: de-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - fi
  splits:
  - name: train
    num_bytes: 621960938
    num_examples: 1871185
  download_size: 275244245
  dataset_size: 621960938
- config_name: de-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - fr
  splits:
  - name: train
    num_bytes: 680963340
    num_examples: 1942666
  download_size: 289325334
  dataset_size: 680963340
- config_name: de-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - hu
  splits:
  - name: train
    num_bytes: 193068884
    num_examples: 563571
  download_size: 186625855
  dataset_size: 193068884
- config_name: de-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - it
  splits:
  - name: train
    num_bytes: 653857504
    num_examples: 1832989
  download_size: 283411719
  dataset_size: 653857504
- config_name: de-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - lt
  splits:
  - name: train
    num_bytes: 182429076
    num_examples: 565892
  download_size: 183552115
  dataset_size: 182429076
- config_name: de-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - lv
  splits:
  - name: train
    num_bytes: 186374102
    num_examples: 573226
  download_size: 183437158
  dataset_size: 186374102
- config_name: de-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - nl
  splits:
  - name: train
    num_bytes: 655711533
    num_examples: 1934111
  download_size: 286849380
  dataset_size: 655711533
- config_name: de-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - pl
  splits:
  - name: train
    num_bytes: 189642761
    num_examples: 579166
  download_size: 187004630
  dataset_size: 189642761
- config_name: de-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - pt
  splits:
  - name: train
    num_bytes: 654723289
    num_examples: 1884176
  download_size: 286068045
  dataset_size: 654723289
- config_name: de-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - ro
  splits:
  - name: train
    num_bytes: 133686126
    num_examples: 385663
  download_size: 168794955
  dataset_size: 133686126
- config_name: de-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - sk
  splits:
  - name: train
    num_bytes: 187484752
    num_examples: 569381
  download_size: 186001546
  dataset_size: 187484752
- config_name: de-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - sl
  splits:
  - name: train
    num_bytes: 171891826
    num_examples: 546212
  download_size: 180994167
  dataset_size: 171891826
- config_name: de-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - de
        - sv
  splits:
  - name: train
    num_bytes: 590635137
    num_examples: 1842026
  download_size: 275145356
  dataset_size: 590635137
- config_name: el-en
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - en
  splits:
  - name: train
    num_bytes: 606689426
    num_examples: 1292180
  download_size: 279571396
  dataset_size: 606689426
- config_name: el-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - es
  splits:
  - name: train
    num_bytes: 621773509
    num_examples: 1272383
  download_size: 271592910
  dataset_size: 621773509
- config_name: el-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - et
  splits:
  - name: train
    num_bytes: 282330974
    num_examples: 599915
  download_size: 175257825
  dataset_size: 282330974
- config_name: el-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - fi
  splits:
  - name: train
    num_bytes: 583209381
    num_examples: 1227612
  download_size: 263682672
  dataset_size: 583209381
- config_name: el-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - fr
  splits:
  - name: train
    num_bytes: 637660521
    num_examples: 1290796
  download_size: 277664049
  dataset_size: 637660521
- config_name: el-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - hu
  splits:
  - name: train
    num_bytes: 293591416
    num_examples: 586250
  download_size: 178679940
  dataset_size: 293591416
- config_name: el-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - it
  splits:
  - name: train
    num_bytes: 619754868
    num_examples: 1231222
  download_size: 271890467
  dataset_size: 619754868
- config_name: el-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - lt
  splits:
  - name: train
    num_bytes: 281773875
    num_examples: 590850
  download_size: 175584581
  dataset_size: 281773875
- config_name: el-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - lv
  splits:
  - name: train
    num_bytes: 287747485
    num_examples: 596929
  download_size: 175479598
  dataset_size: 287747485
- config_name: el-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - nl
  splits:
  - name: train
    num_bytes: 619747333
    num_examples: 1277297
  download_size: 275234928
  dataset_size: 619747333
- config_name: el-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - pl
  splits:
  - name: train
    num_bytes: 291216179
    num_examples: 591069
  download_size: 179121800
  dataset_size: 291216179
- config_name: el-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - pt
  splits:
  - name: train
    num_bytes: 619089974
    num_examples: 1261188
  download_size: 274510323
  dataset_size: 619089974
- config_name: el-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - ro
  splits:
  - name: train
    num_bytes: 186445257
    num_examples: 372839
  download_size: 160638758
  dataset_size: 186445257
- config_name: el-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - sk
  splits:
  - name: train
    num_bytes: 290180513
    num_examples: 600684
  download_size: 178030033
  dataset_size: 290180513
- config_name: el-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - sl
  splits:
  - name: train
    num_bytes: 269700597
    num_examples: 579109
  download_size: 172981018
  dataset_size: 269700597
- config_name: el-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - el
        - sv
  splits:
  - name: train
    num_bytes: 598841855
    num_examples: 1273743
  download_size: 264310725
  dataset_size: 598841855
- config_name: en-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - es
  splits:
  - name: train
    num_bytes: 645806091
    num_examples: 2009073
  download_size: 285275775
  dataset_size: 645806091
- config_name: en-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - et
  splits:
  - name: train
    num_bytes: 190057019
    num_examples: 651236
  download_size: 185547113
  dataset_size: 190057019
- config_name: en-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - fi
  splits:
  - name: train
    num_bytes: 612796933
    num_examples: 1969624
  download_size: 277526569
  dataset_size: 612796933
- config_name: en-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - fr
  splits:
  - name: train
    num_bytes: 674922213
    num_examples: 2051014
  download_size: 291576418
  dataset_size: 674922213
- config_name: en-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - hu
  splits:
  - name: train
    num_bytes: 200219937
    num_examples: 625178
  download_size: 189011893
  dataset_size: 200219937
- config_name: en-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - it
  splits:
  - name: train
    num_bytes: 649121845
    num_examples: 1946253
  download_size: 285912672
  dataset_size: 649121845
- config_name: en-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - lt
  splits:
  - name: train
    num_bytes: 188689136
    num_examples: 634284
  download_size: 185983375
  dataset_size: 188689136
- config_name: en-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - lv
  splits:
  - name: train
    num_bytes: 193229251
    num_examples: 639318
  download_size: 185755567
  dataset_size: 193229251
- config_name: en-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - nl
  splits:
  - name: train
    num_bytes: 648639286
    num_examples: 2027447
  download_size: 289379311
  dataset_size: 648639286
- config_name: en-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - pl
  splits:
  - name: train
    num_bytes: 197111400
    num_examples: 631160
  download_size: 189526719
  dataset_size: 197111400
- config_name: en-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - pt
  splits:
  - name: train
    num_bytes: 649484557
    num_examples: 2002943
  download_size: 288280201
  dataset_size: 649484557
- config_name: en-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - ro
  splits:
  - name: train
    num_bytes: 127546377
    num_examples: 400356
  download_size: 170919568
  dataset_size: 127546377
- config_name: en-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - sk
  splits:
  - name: train
    num_bytes: 194301334
    num_examples: 639958
  download_size: 188348297
  dataset_size: 194301334
- config_name: en-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - sl
  splits:
  - name: train
    num_bytes: 179662136
    num_examples: 624803
  download_size: 182965262
  dataset_size: 179662136
- config_name: en-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - sv
  splits:
  - name: train
    num_bytes: 583167767
    num_examples: 1892723
  download_size: 277758290
  dataset_size: 583167767
- config_name: es-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - et
  splits:
  - name: train
    num_bytes: 194077194
    num_examples: 618350
  download_size: 177610241
  dataset_size: 194077194
- config_name: es-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - fi
  splits:
  - name: train
    num_bytes: 624352744
    num_examples: 1901596
  download_size: 269239484
  dataset_size: 624352744
- config_name: es-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - fr
  splits:
  - name: train
    num_bytes: 686124508
    num_examples: 1982990
  download_size: 283235952
  dataset_size: 686124508
- config_name: es-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - hu
  splits:
  - name: train
    num_bytes: 207128226
    num_examples: 604007
  download_size: 181057656
  dataset_size: 207128226
- config_name: es-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - it
  splits:
  - name: train
    num_bytes: 659832078
    num_examples: 1880982
  download_size: 277595675
  dataset_size: 659832078
- config_name: es-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - lt
  splits:
  - name: train
    num_bytes: 195424327
    num_examples: 611082
  download_size: 178003980
  dataset_size: 195424327
- config_name: es-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - lv
  splits:
  - name: train
    num_bytes: 199870901
    num_examples: 615496
  download_size: 177847154
  dataset_size: 199870901
- config_name: es-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - nl
  splits:
  - name: train
    num_bytes: 659669649
    num_examples: 1954351
  download_size: 281116315
  dataset_size: 659669649
- config_name: es-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - pl
  splits:
  - name: train
    num_bytes: 203960308
    num_examples: 609297
  download_size: 181528675
  dataset_size: 203960308
- config_name: es-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - pt
  splits:
  - name: train
    num_bytes: 660610724
    num_examples: 1933321
  download_size: 280106119
  dataset_size: 660610724
- config_name: es-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - ro
  splits:
  - name: train
    num_bytes: 132099300
    num_examples: 387653
  download_size: 163044165
  dataset_size: 132099300
- config_name: es-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - sk
  splits:
  - name: train
    num_bytes: 201711884
    num_examples: 619027
  download_size: 180405877
  dataset_size: 201711884
- config_name: es-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - sl
  splits:
  - name: train
    num_bytes: 185526475
    num_examples: 599168
  download_size: 175277856
  dataset_size: 185526475
- config_name: es-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - sv
  splits:
  - name: train
    num_bytes: 594313079
    num_examples: 1826855
  download_size: 269509656
  dataset_size: 594313079
- config_name: et-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - fi
  splits:
  - name: train
    num_bytes: 186411056
    num_examples: 620939
  download_size: 169999062
  dataset_size: 186411056
- config_name: et-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - fr
  splits:
  - name: train
    num_bytes: 199983753
    num_examples: 630126
  download_size: 183656005
  dataset_size: 199983753
- config_name: et-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - hu
  splits:
  - name: train
    num_bytes: 195505472
    num_examples: 628044
  download_size: 88087464
  dataset_size: 195505472
- config_name: et-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - it
  splits:
  - name: train
    num_bytes: 195809060
    num_examples: 607088
  download_size: 178033859
  dataset_size: 195809060
- config_name: et-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - lt
  splits:
  - name: train
    num_bytes: 181591116
    num_examples: 622003
  download_size: 85049307
  dataset_size: 181591116
- config_name: et-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - lv
  splits:
  - name: train
    num_bytes: 186830733
    num_examples: 637468
  download_size: 84838432
  dataset_size: 186830733
- config_name: et-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - nl
  splits:
  - name: train
    num_bytes: 192674741
    num_examples: 621150
  download_size: 181153226
  dataset_size: 192674741
- config_name: et-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - pl
  splits:
  - name: train
    num_bytes: 191037236
    num_examples: 639046
  download_size: 88518099
  dataset_size: 191037236
- config_name: et-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - pt
  splits:
  - name: train
    num_bytes: 191956598
    num_examples: 616238
  download_size: 180565606
  dataset_size: 191956598
- config_name: et-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - ro
  splits:
  - name: train
    num_bytes: 122191834
    num_examples: 389087
  download_size: 70103283
  dataset_size: 122191834
- config_name: et-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - sk
  splits:
  - name: train
    num_bytes: 188728692
    num_examples: 634168
  download_size: 87465164
  dataset_size: 188728692
- config_name: et-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - sl
  splits:
  - name: train
    num_bytes: 172379502
    num_examples: 609731
  download_size: 82340544
  dataset_size: 172379502
- config_name: et-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - sv
  splits:
  - name: train
    num_bytes: 189514511
    num_examples: 656646
  download_size: 170410673
  dataset_size: 189514511
- config_name: fi-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - fr
  splits:
  - name: train
    num_bytes: 658941046
    num_examples: 1964126
  download_size: 275801815
  dataset_size: 658941046
- config_name: fi-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - hu
  splits:
  - name: train
    num_bytes: 199866442
    num_examples: 606348
  download_size: 173436552
  dataset_size: 199866442
- config_name: fi-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - it
  splits:
  - name: train
    num_bytes: 630203540
    num_examples: 1845203
  download_size: 269923911
  dataset_size: 630203540
- config_name: fi-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - lt
  splits:
  - name: train
    num_bytes: 187759286
    num_examples: 613113
  download_size: 170349480
  dataset_size: 187759286
- config_name: fi-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - lv
  splits:
  - name: train
    num_bytes: 192467707
    num_examples: 616816
  download_size: 170245682
  dataset_size: 192467707
- config_name: fi-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - nl
  splits:
  - name: train
    num_bytes: 629656948
    num_examples: 1940808
  download_size: 273354291
  dataset_size: 629656948
- config_name: fi-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - pl
  splits:
  - name: train
    num_bytes: 196692739
    num_examples: 612689
  download_size: 173878256
  dataset_size: 196692739
- config_name: fi-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - pt
  splits:
  - name: train
    num_bytes: 625813096
    num_examples: 1885062
  download_size: 272449208
  dataset_size: 625813096
- config_name: fi-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - ro
  splits:
  - name: train
    num_bytes: 128424133
    num_examples: 391430
  download_size: 155413895
  dataset_size: 128424133
- config_name: fi-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - sk
  splits:
  - name: train
    num_bytes: 194407846
    num_examples: 623686
  download_size: 172774950
  dataset_size: 194407846
- config_name: fi-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - sl
  splits:
  - name: train
    num_bytes: 177582459
    num_examples: 596661
  download_size: 167734483
  dataset_size: 177582459
- config_name: fi-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - sv
  splits:
  - name: train
    num_bytes: 590589773
    num_examples: 1883314
  download_size: 262138250
  dataset_size: 590589773
- config_name: fr-hu
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - hu
  splits:
  - name: train
    num_bytes: 213345700
    num_examples: 615791
  download_size: 187084192
  dataset_size: 213345700
- config_name: fr-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - it
  splits:
  - name: train
    num_bytes: 694854791
    num_examples: 1943673
  download_size: 283931275
  dataset_size: 694854791
- config_name: fr-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - lt
  splits:
  - name: train
    num_bytes: 200610624
    num_examples: 620660
  download_size: 184000557
  dataset_size: 200610624
- config_name: fr-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - lv
  splits:
  - name: train
    num_bytes: 205814878
    num_examples: 626280
  download_size: 183883161
  dataset_size: 205814878
- config_name: fr-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - nl
  splits:
  - name: train
    num_bytes: 693784423
    num_examples: 2029551
  download_size: 287389308
  dataset_size: 693784423
- config_name: fr-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - pl
  splits:
  - name: train
    num_bytes: 210001183
    num_examples: 621402
  download_size: 187532501
  dataset_size: 210001183
- config_name: fr-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - pt
  splits:
  - name: train
    num_bytes: 689789351
    num_examples: 1980132
  download_size: 286436517
  dataset_size: 689789351
- config_name: fr-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - ro
  splits:
  - name: train
    num_bytes: 133973522
    num_examples: 387846
  download_size: 169044065
  dataset_size: 133973522
- config_name: fr-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - sk
  splits:
  - name: train
    num_bytes: 207736993
    num_examples: 631846
  download_size: 186425028
  dataset_size: 207736993
- config_name: fr-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - sl
  splits:
  - name: train
    num_bytes: 190523805
    num_examples: 606897
  download_size: 181374508
  dataset_size: 190523805
- config_name: fr-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - sv
  splits:
  - name: train
    num_bytes: 623443554
    num_examples: 1880390
  download_size: 275743717
  dataset_size: 623443554
- config_name: hu-it
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - it
  splits:
  - name: train
    num_bytes: 207768447
    num_examples: 589563
  download_size: 181442707
  dataset_size: 207768447
- config_name: hu-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - lt
  splits:
  - name: train
    num_bytes: 195366291
    num_examples: 610298
  download_size: 88456570
  dataset_size: 195366291
- config_name: hu-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - lv
  splits:
  - name: train
    num_bytes: 200475742
    num_examples: 621101
  download_size: 88300472
  dataset_size: 200475742
- config_name: hu-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - nl
  splits:
  - name: train
    num_bytes: 205617797
    num_examples: 605806
  download_size: 184560090
  dataset_size: 205617797
- config_name: hu-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - pl
  splits:
  - name: train
    num_bytes: 204095081
    num_examples: 621820
  download_size: 91932370
  dataset_size: 204095081
- config_name: hu-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - pt
  splits:
  - name: train
    num_bytes: 204293487
    num_examples: 599639
  download_size: 184009255
  dataset_size: 204293487
- config_name: hu-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - ro
  splits:
  - name: train
    num_bytes: 129428826
    num_examples: 377239
  download_size: 73491360
  dataset_size: 129428826
- config_name: hu-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - sk
  splits:
  - name: train
    num_bytes: 201934745
    num_examples: 618247
  download_size: 90886028
  dataset_size: 201934745
- config_name: hu-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - sl
  splits:
  - name: train
    num_bytes: 187295201
    num_examples: 601671
  download_size: 85848963
  dataset_size: 187295201
- config_name: hu-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - hu
        - sv
  splits:
  - name: train
    num_bytes: 201010172
    num_examples: 631872
  download_size: 173806423
  dataset_size: 201010172
- config_name: it-lt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - lt
  splits:
  - name: train
    num_bytes: 194730310
    num_examples: 593003
  download_size: 178347064
  dataset_size: 194730310
- config_name: it-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - lv
  splits:
  - name: train
    num_bytes: 200106637
    num_examples: 599394
  download_size: 178242433
  dataset_size: 200106637
- config_name: it-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - nl
  splits:
  - name: train
    num_bytes: 667554644
    num_examples: 1919855
  download_size: 281535603
  dataset_size: 667554644
- config_name: it-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - pl
  splits:
  - name: train
    num_bytes: 204343831
    num_examples: 594472
  download_size: 181869443
  dataset_size: 204343831
- config_name: it-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - pt
  splits:
  - name: train
    num_bytes: 662888825
    num_examples: 1877432
  download_size: 280344907
  dataset_size: 662888825
- config_name: it-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - ro
  splits:
  - name: train
    num_bytes: 130259763
    num_examples: 367904
  download_size: 163411428
  dataset_size: 130259763
- config_name: it-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - sk
  splits:
  - name: train
    num_bytes: 201935420
    num_examples: 603467
  download_size: 180786705
  dataset_size: 201935420
- config_name: it-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - sl
  splits:
  - name: train
    num_bytes: 184859642
    num_examples: 579968
  download_size: 175764011
  dataset_size: 184859642
- config_name: it-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - it
        - sv
  splits:
  - name: train
    num_bytes: 596242670
    num_examples: 1766096
  download_size: 269861070
  dataset_size: 596242670
- config_name: lt-lv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - lv
  splits:
  - name: train
    num_bytes: 188060955
    num_examples: 621857
  download_size: 85277601
  dataset_size: 188060955
- config_name: lt-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - nl
  splits:
  - name: train
    num_bytes: 193749342
    num_examples: 613308
  download_size: 181477191
  dataset_size: 193749342
- config_name: lt-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - pl
  splits:
  - name: train
    num_bytes: 191712803
    num_examples: 617296
  download_size: 88896956
  dataset_size: 191712803
- config_name: lt-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - pt
  splits:
  - name: train
    num_bytes: 191496681
    num_examples: 603223
  download_size: 180925582
  dataset_size: 191496681
- config_name: lt-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - ro
  splits:
  - name: train
    num_bytes: 122958316
    num_examples: 384679
  download_size: 70386543
  dataset_size: 122958316
- config_name: lt-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - sk
  splits:
  - name: train
    num_bytes: 189101772
    num_examples: 622997
  download_size: 87817035
  dataset_size: 189101772
- config_name: lt-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - sl
  splits:
  - name: train
    num_bytes: 173710681
    num_examples: 602442
  download_size: 82776077
  dataset_size: 173710681
- config_name: lt-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lt
        - sv
  splits:
  - name: train
    num_bytes: 188733924
    num_examples: 628817
  download_size: 170761964
  dataset_size: 188733924
- config_name: lv-nl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lv
        - nl
  splits:
  - name: train
    num_bytes: 198965150
    num_examples: 618352
  download_size: 181381125
  dataset_size: 198965150
- config_name: lv-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lv
        - pl
  splits:
  - name: train
    num_bytes: 198845485
    num_examples: 638453
  download_size: 88758761
  dataset_size: 198845485
- config_name: lv-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lv
        - pt
  splits:
  - name: train
    num_bytes: 198412113
    num_examples: 615580
  download_size: 180801629
  dataset_size: 198412113
- config_name: lv-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lv
        - ro
  splits:
  - name: train
    num_bytes: 127087848
    num_examples: 390857
  download_size: 70314589
  dataset_size: 127087848
- config_name: lv-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lv
        - sk
  splits:
  - name: train
    num_bytes: 194466502
    num_examples: 629803
  download_size: 87693678
  dataset_size: 194466502
- config_name: lv-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lv
        - sl
  splits:
  - name: train
    num_bytes: 178009999
    num_examples: 607381
  download_size: 82594307
  dataset_size: 178009999
- config_name: lv-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - lv
        - sv
  splits:
  - name: train
    num_bytes: 194010201
    num_examples: 643600
  download_size: 170626197
  dataset_size: 194010201
- config_name: nl-pl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - nl
        - pl
  splits:
  - name: train
    num_bytes: 202577192
    num_examples: 612797
  download_size: 185014758
  dataset_size: 202577192
- config_name: nl-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - nl
        - pt
  splits:
  - name: train
    num_bytes: 666335238
    num_examples: 1957189
  download_size: 284348205
  dataset_size: 666335238
- config_name: nl-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - nl
        - ro
  splits:
  - name: train
    num_bytes: 129250903
    num_examples: 380736
  download_size: 166521373
  dataset_size: 129250903
- config_name: nl-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - nl
        - sk
  splits:
  - name: train
    num_bytes: 200169118
    num_examples: 622650
  download_size: 183925381
  dataset_size: 200169118
- config_name: nl-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - nl
        - sl
  splits:
  - name: train
    num_bytes: 184588246
    num_examples: 600023
  download_size: 178917463
  dataset_size: 184588246
- config_name: nl-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - nl
        - sv
  splits:
  - name: train
    num_bytes: 600924875
    num_examples: 1870685
  download_size: 273628695
  dataset_size: 600924875
- config_name: pl-pt
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pl
        - pt
  splits:
  - name: train
    num_bytes: 202077773
    num_examples: 608181
  download_size: 184478728
  dataset_size: 202077773
- config_name: pl-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pl
        - ro
  splits:
  - name: train
    num_bytes: 130211235
    num_examples: 389341
  download_size: 73935732
  dataset_size: 130211235
- config_name: pl-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pl
        - sk
  splits:
  - name: train
    num_bytes: 198571926
    num_examples: 624330
  download_size: 91348753
  dataset_size: 198571926
- config_name: pl-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pl
        - sl
  splits:
  - name: train
    num_bytes: 182038291
    num_examples: 600511
  download_size: 86313727
  dataset_size: 182038291
- config_name: pl-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pl
        - sv
  splits:
  - name: train
    num_bytes: 197987693
    num_examples: 657951
  download_size: 174170909
  dataset_size: 197987693
- config_name: pt-ro
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pt
        - ro
  splits:
  - name: train
    num_bytes: 128921939
    num_examples: 381404
  download_size: 165965899
  dataset_size: 128921939
- config_name: pt-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pt
        - sk
  splits:
  - name: train
    num_bytes: 197887183
    num_examples: 611895
  download_size: 183332222
  dataset_size: 197887183
- config_name: pt-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pt
        - sl
  splits:
  - name: train
    num_bytes: 182608021
    num_examples: 593455
  download_size: 178188570
  dataset_size: 182608021
- config_name: pt-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - pt
        - sv
  splits:
  - name: train
    num_bytes: 598677198
    num_examples: 1823402
  download_size: 272500072
  dataset_size: 598677198
- config_name: ro-sk
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ro
        - sk
  splits:
  - name: train
    num_bytes: 125917165
    num_examples: 387839
  download_size: 72817194
  dataset_size: 125917165
- config_name: ro-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ro
        - sl
  splits:
  - name: train
    num_bytes: 116060031
    num_examples: 374859
  download_size: 67766532
  dataset_size: 116060031
- config_name: ro-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ro
        - sv
  splits:
  - name: train
    num_bytes: 126359961
    num_examples: 390133
  download_size: 155757942
  dataset_size: 126359961
- config_name: sk-sl
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - sk
        - sl
  splits:
  - name: train
    num_bytes: 179514252
    num_examples: 609698
  download_size: 85175048
  dataset_size: 179514252
- config_name: sk-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - sk
        - sv
  splits:
  - name: train
    num_bytes: 195200876
    num_examples: 636353
  download_size: 173202439
  dataset_size: 195200876
- config_name: sl-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - sl
        - sv
  splits:
  - name: train
    num_bytes: 178446367
    num_examples: 608740
  download_size: 168196323
  dataset_size: 178446367
---

# Dataset Card for europarl-bilingual

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** [Statmt](http://www.statmt.org/europarl/)
- **Repository:** [OPUS Europarl](https://opus.nlpl.eu/Europarl.php)
- **Paper:** [Aclweb](https://www.aclweb.org/anthology/L12-1246/)
- **Leaderboard:** [Needs More Information]
- **Point of Contact:** [Needs More Information]

### Dataset Summary

A parallel corpus extracted from the European Parliament web site by Philipp Koehn (University of Edinburgh). The main intended use is to aid statistical machine translation research.

To load a language pair which isn't part of the config, all you need to do is specify the language code as pairs.
You can find the valid pairs in Homepage section of Dataset Description: https://opus.nlpl.eu/Europarl.php
E.g.

`dataset = load_dataset("europarl_bilingual", lang1="fi", lang2="fr")`


### Supported Tasks and Leaderboards

Tasks: Machine Translation, Cross Lingual Word Embeddings (CWLE) Alignment

### Languages

- 21 languages, 211 bitexts
- total number of files: 207,775
- total number of tokens: 759.05M
- total number of sentence fragments: 30.32M

Every pair of the following languages is available:
- bg
- cs
- da
- de
- el
- en
- es
- et
- fi
- fr
- hu
- it
- lt
- lv
- nl
- pl
- pt
- ro
- sk
- sl
- sv


## Dataset Structure

### Data Instances

Here is an example from the en-fr pair:
```
{
  'translation': {
    'en': 'Resumption of the session',
    'fr': 'Reprise de la session'
  }
}
```

### Data Fields

- `translation`: a dictionary containing two strings paired with a key indicating the corresponding language.

### Data Splits

- `train`: only train split is provided. Authors did not provide a separation of examples in `train`, `dev` and `test`.

## Dataset Creation

### Curation Rationale

[Needs More Information]

### Source Data

#### Initial Data Collection and Normalization

[Needs More Information]

#### Who are the source language producers?

[Needs More Information]

### Annotations

#### Annotation process

[Needs More Information]

#### Who are the annotators?

[Needs More Information]

### Personal and Sensitive Information

[Needs More Information]

## Considerations for Using the Data

### Social Impact of Dataset

[Needs More Information]

### Discussion of Biases

[Needs More Information]

### Other Known Limitations

[Needs More Information]

## Additional Information

### Dataset Curators

[Needs More Information]

### Licensing Information

The data set comes with the same license
as the original sources.
Please, check the information about the source
that is given on
http://opus.nlpl.eu/Europarl-v8.php

### Citation Information

```
@InProceedings{TIEDEMANN12.463,
  author = {J�rg Tiedemann},
  title = {Parallel Data, Tools and Interfaces in OPUS},
  booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)},
  year = {2012},
  month = {may},
  date = {23-25},
  address = {Istanbul, Turkey},
  editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Ugur Dogan and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {978-2-9517408-7-7},
  language = {english}
 }
 ```

### Contributions

Thanks to [@lucadiliello](https://github.com/lucadiliello) for adding this dataset.