task_categories:translation annotations_creators:found language_creators:found multilinguality:multilingual size_categories:10K<n<100K source_datasets:original language:ar language:en language:es language:et language:fa language:fi language:fr language:ru language:so language:sv language:tr language:zh license:unknown region:us
A parallel corpus of 12 languages, 66 bitexts.
@InProceedings{TIEDEMANN12.463,
  author = {J�rg Tiedemann},
  title = {Parallel Data, Tools and Interfaces in OPUS},
  booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)},
  year = {2012},
  month = {may},
  date = {23-25},
  address = {Istanbul, Turkey},
  editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Ugur Dogan and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {978-2-9517408-7-7},
  language = {english}
}
---
annotations_creators:
- found
language_creators:
- found
language:
- ar
- en
- es
- et
- fa
- fi
- fr
- ru
- so
- sv
- tr
- zh
license:
- unknown
multilinguality:
- multilingual
size_categories:
- 10K<n<100K
source_datasets:
- original
task_categories:
- translation
task_ids: []
paperswithcode_id: null
pretty_name: OpusInfopankki
dataset_info:
- config_name: ar-en
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - en
  splits:
  - name: train
    num_bytes: 10133385
    num_examples: 50769
  download_size: 1675642
  dataset_size: 10133385
- config_name: ar-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - es
  splits:
  - name: train
    num_bytes: 8665395
    num_examples: 40514
  download_size: 1481047
  dataset_size: 8665395
- config_name: ar-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - et
  splits:
  - name: train
    num_bytes: 9087595
    num_examples: 46573
  download_size: 1526418
  dataset_size: 9087595
- config_name: ar-fa
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - fa
  splits:
  - name: train
    num_bytes: 12220236
    num_examples: 47007
  download_size: 1817143
  dataset_size: 12220236
- config_name: ar-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - fi
  splits:
  - name: train
    num_bytes: 9524305
    num_examples: 49608
  download_size: 1599735
  dataset_size: 9524305
- config_name: ar-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - fr
  splits:
  - name: train
    num_bytes: 8877669
    num_examples: 41061
  download_size: 1516374
  dataset_size: 8877669
- config_name: ar-ru
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - ru
  splits:
  - name: train
    num_bytes: 13648242
    num_examples: 50286
  download_size: 1970843
  dataset_size: 13648242
- config_name: ar-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - so
  splits:
  - name: train
    num_bytes: 9555588
    num_examples: 44736
  download_size: 1630676
  dataset_size: 9555588
- config_name: ar-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - sv
  splits:
  - name: train
    num_bytes: 8585175
    num_examples: 43085
  download_size: 1469533
  dataset_size: 8585175
- config_name: ar-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - tr
  splits:
  - name: train
    num_bytes: 8691117
    num_examples: 41710
  download_size: 1481787
  dataset_size: 8691117
- config_name: ar-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ar
        - zh
  splits:
  - name: train
    num_bytes: 5973658
    num_examples: 29943
  download_size: 1084404
  dataset_size: 5973658
- config_name: en-es
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - es
  splits:
  - name: train
    num_bytes: 6934023
    num_examples: 42657
  download_size: 1333020
  dataset_size: 6934023
- config_name: en-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - et
  splits:
  - name: train
    num_bytes: 8211610
    num_examples: 58410
  download_size: 1509893
  dataset_size: 8211610
- config_name: en-fa
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - fa
  splits:
  - name: train
    num_bytes: 10166345
    num_examples: 48277
  download_size: 1657826
  dataset_size: 10166345
- config_name: en-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - fi
  splits:
  - name: train
    num_bytes: 10913673
    num_examples: 84645
  download_size: 1860908
  dataset_size: 10913673
- config_name: en-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - fr
  splits:
  - name: train
    num_bytes: 8903231
    num_examples: 56120
  download_size: 1572554
  dataset_size: 8903231
- config_name: en-ru
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - ru
  splits:
  - name: train
    num_bytes: 15918259
    num_examples: 75305
  download_size: 2220544
  dataset_size: 15918259
- config_name: en-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - so
  splits:
  - name: train
    num_bytes: 7602330
    num_examples: 47220
  download_size: 1467156
  dataset_size: 7602330
- config_name: en-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - sv
  splits:
  - name: train
    num_bytes: 7411023
    num_examples: 51749
  download_size: 1384139
  dataset_size: 7411023
- config_name: en-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - tr
  splits:
  - name: train
    num_bytes: 6929194
    num_examples: 44030
  download_size: 1329853
  dataset_size: 6929194
- config_name: en-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - en
        - zh
  splits:
  - name: train
    num_bytes: 4666987
    num_examples: 29907
  download_size: 894750
  dataset_size: 4666987
- config_name: es-et
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - et
  splits:
  - name: train
    num_bytes: 6611996
    num_examples: 42342
  download_size: 1301067
  dataset_size: 6611996
- config_name: es-fa
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - fa
  splits:
  - name: train
    num_bytes: 9338250
    num_examples: 41218
  download_size: 1558933
  dataset_size: 9338250
- config_name: es-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - fi
  splits:
  - name: train
    num_bytes: 6436338
    num_examples: 41479
  download_size: 1253298
  dataset_size: 6436338
- config_name: es-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - fr
  splits:
  - name: train
    num_bytes: 7368764
    num_examples: 41940
  download_size: 1406167
  dataset_size: 7368764
- config_name: es-ru
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - ru
  splits:
  - name: train
    num_bytes: 9844977
    num_examples: 41061
  download_size: 1595928
  dataset_size: 9844977
- config_name: es-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - so
  splits:
  - name: train
    num_bytes: 7257078
    num_examples: 41752
  download_size: 1438303
  dataset_size: 7257078
- config_name: es-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - sv
  splits:
  - name: train
    num_bytes: 6650692
    num_examples: 41256
  download_size: 1291291
  dataset_size: 6650692
- config_name: es-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - tr
  splits:
  - name: train
    num_bytes: 7144105
    num_examples: 42191
  download_size: 1372312
  dataset_size: 7144105
- config_name: es-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - es
        - zh
  splits:
  - name: train
    num_bytes: 4358775
    num_examples: 26004
  download_size: 810902
  dataset_size: 4358775
- config_name: et-fa
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - fa
  splits:
  - name: train
    num_bytes: 9796036
    num_examples: 47633
  download_size: 1603405
  dataset_size: 9796036
- config_name: et-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - fi
  splits:
  - name: train
    num_bytes: 7657037
    num_examples: 57353
  download_size: 1425641
  dataset_size: 7657037
- config_name: et-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - fr
  splits:
  - name: train
    num_bytes: 7012470
    num_examples: 44753
  download_size: 1355458
  dataset_size: 7012470
- config_name: et-ru
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - ru
  splits:
  - name: train
    num_bytes: 12001439
    num_examples: 55901
  download_size: 1812764
  dataset_size: 12001439
- config_name: et-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - so
  splits:
  - name: train
    num_bytes: 7260837
    num_examples: 46933
  download_size: 1432147
  dataset_size: 7260837
- config_name: et-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - sv
  splits:
  - name: train
    num_bytes: 6523081
    num_examples: 46775
  download_size: 1268616
  dataset_size: 6523081
- config_name: et-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - tr
  splits:
  - name: train
    num_bytes: 6621705
    num_examples: 43729
  download_size: 1299911
  dataset_size: 6621705
- config_name: et-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - et
        - zh
  splits:
  - name: train
    num_bytes: 4305297
    num_examples: 27826
  download_size: 808812
  dataset_size: 4305297
- config_name: fa-fi
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fa
        - fi
  splits:
  - name: train
    num_bytes: 9579297
    num_examples: 46924
  download_size: 1574886
  dataset_size: 9579297
- config_name: fa-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fa
        - fr
  splits:
  - name: train
    num_bytes: 9574294
    num_examples: 41975
  download_size: 1591112
  dataset_size: 9574294
- config_name: fa-ru
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fa
        - ru
  splits:
  - name: train
    num_bytes: 13544491
    num_examples: 47814
  download_size: 1947217
  dataset_size: 13544491
- config_name: fa-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fa
        - so
  splits:
  - name: train
    num_bytes: 10254763
    num_examples: 45571
  download_size: 1722085
  dataset_size: 10254763
- config_name: fa-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fa
        - sv
  splits:
  - name: train
    num_bytes: 9153792
    num_examples: 43510
  download_size: 1519092
  dataset_size: 9153792
- config_name: fa-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fa
        - tr
  splits:
  - name: train
    num_bytes: 9393249
    num_examples: 42708
  download_size: 1559312
  dataset_size: 9393249
- config_name: fa-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fa
        - zh
  splits:
  - name: train
    num_bytes: 5792463
    num_examples: 27748
  download_size: 1027887
  dataset_size: 5792463
- config_name: fi-fr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - fr
  splits:
  - name: train
    num_bytes: 8310899
    num_examples: 55087
  download_size: 1488763
  dataset_size: 8310899
- config_name: fi-ru
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - ru
  splits:
  - name: train
    num_bytes: 15188232
    num_examples: 74699
  download_size: 2142712
  dataset_size: 15188232
- config_name: fi-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - so
  splits:
  - name: train
    num_bytes: 7076261
    num_examples: 46032
  download_size: 1387424
  dataset_size: 7076261
- config_name: fi-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - sv
  splits:
  - name: train
    num_bytes: 6947272
    num_examples: 51506
  download_size: 1312272
  dataset_size: 6947272
- config_name: fi-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - tr
  splits:
  - name: train
    num_bytes: 6438756
    num_examples: 42781
  download_size: 1251294
  dataset_size: 6438756
- config_name: fi-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fi
        - zh
  splits:
  - name: train
    num_bytes: 4434192
    num_examples: 29503
  download_size: 864043
  dataset_size: 4434192
- config_name: fr-ru
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - ru
  splits:
  - name: train
    num_bytes: 12564244
    num_examples: 54213
  download_size: 1862751
  dataset_size: 12564244
- config_name: fr-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - so
  splits:
  - name: train
    num_bytes: 7473599
    num_examples: 42652
  download_size: 1471709
  dataset_size: 7473599
- config_name: fr-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - sv
  splits:
  - name: train
    num_bytes: 7027603
    num_examples: 43524
  download_size: 1343061
  dataset_size: 7027603
- config_name: fr-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - tr
  splits:
  - name: train
    num_bytes: 7341118
    num_examples: 43036
  download_size: 1399175
  dataset_size: 7341118
- config_name: fr-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - fr
        - zh
  splits:
  - name: train
    num_bytes: 4525133
    num_examples: 26654
  download_size: 850456
  dataset_size: 4525133
- config_name: ru-so
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ru
        - so
  splits:
  - name: train
    num_bytes: 10809233
    num_examples: 45430
  download_size: 1742599
  dataset_size: 10809233
- config_name: ru-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ru
        - sv
  splits:
  - name: train
    num_bytes: 10517473
    num_examples: 47672
  download_size: 1634682
  dataset_size: 10517473
- config_name: ru-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ru
        - tr
  splits:
  - name: train
    num_bytes: 9930632
    num_examples: 42587
  download_size: 1591805
  dataset_size: 9930632
- config_name: ru-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - ru
        - zh
  splits:
  - name: train
    num_bytes: 6417832
    num_examples: 29523
  download_size: 1109274
  dataset_size: 6417832
- config_name: so-sv
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - so
        - sv
  splits:
  - name: train
    num_bytes: 6763794
    num_examples: 42384
  download_size: 1353892
  dataset_size: 6763794
- config_name: so-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - so
        - tr
  splits:
  - name: train
    num_bytes: 7272389
    num_examples: 43242
  download_size: 1440287
  dataset_size: 7272389
- config_name: so-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - so
        - zh
  splits:
  - name: train
    num_bytes: 4535979
    num_examples: 27090
  download_size: 859149
  dataset_size: 4535979
- config_name: sv-tr
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - sv
        - tr
  splits:
  - name: train
    num_bytes: 6637784
    num_examples: 42555
  download_size: 1288209
  dataset_size: 6637784
- config_name: sv-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - sv
        - zh
  splits:
  - name: train
    num_bytes: 4216429
    num_examples: 26898
  download_size: 779012
  dataset_size: 4216429
- config_name: tr-zh
  features:
  - name: translation
    dtype:
      translation:
        languages:
        - tr
        - zh
  splits:
  - name: train
    num_bytes: 4494095
    num_examples: 27323
  download_size: 841988
  dataset_size: 4494095
config_names:
- ar-en
- ar-es
- ar-et
- ar-fa
- ar-fi
- ar-fr
- ar-ru
- ar-so
- ar-sv
- ar-tr
- ar-zh
- en-es
- en-et
- en-fa
- en-fi
- en-fr
- en-ru
- en-so
- en-sv
- en-tr
- en-zh
- es-et
- es-fa
- es-fi
- es-fr
- es-ru
- es-so
- es-sv
- es-tr
- es-zh
- et-fa
- et-fi
- et-fr
- et-ru
- et-so
- et-sv
- et-tr
- et-zh
- fa-fi
- fa-fr
- fa-ru
- fa-so
- fa-sv
- fa-tr
- fa-zh
- fi-fr
- fi-ru
- fi-so
- fi-sv
- fi-tr
- fi-zh
- fr-ru
- fr-so
- fr-sv
- fr-tr
- fr-zh
- ru-so
- ru-sv
- ru-tr
- ru-zh
- so-sv
- so-tr
- so-zh
- sv-tr
- sv-zh
- tr-zh
---

# Dataset Card for [Dataset Name]

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:**[infopankki](http://opus.nlpl.eu/infopankki-v1.php)
- **Repository:**
- **Paper:**
- **Leaderboard:**
- **Point of Contact:**

### Dataset Summary

A parallel corpus of 12 languages, 66 bitexts.

### Supported Tasks and Leaderboards

The underlying task is machine translation.

### Languages

[More Information Needed]

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

[More Information Needed]

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

```
@InProceedings{TIEDEMANN12.463,
  author = {J�rg Tiedemann},
  title = {Parallel Data, Tools and Interfaces in OPUS},
  booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)},
  year = {2012},
  month = {may},
  date = {23-25},
  address = {Istanbul, Turkey},
  editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Ugur Dogan and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {978-2-9517408-7-7},
  language = {english}
}
```

### Contributions

Thanks to [@patil-suraj](https://github.com/patil-suraj) for adding this dataset.