multilinguality:multilingual size_categories:10K<n<100K language:en language:fr license:apache-2.0 text-to-text keyphrase-generation region:us
The datasets are derived from Papyrus, a repository at Université de Montréal containing various types of documents, mainly theses with abstracts in multiple languages, primarily French and English. The entries are provided in four different configurations based on the languages of abstracts, allowing for generating keyphrases in French, English, or multiple languages.
- Papyrus-f: From the French abstracts, generate French keyphrases.
- Papyrus-e: From the English abstracts, generate English keyphrases.
- Papyrus-m: From one abstract in any language, generate keyphrases in that same
language (one language to one language).
- Papyrus-a: From the multiple abstracts of a document, generate keyphrases in the
same languages as the abstracts (many to many languages).
@inproceedings{NEURIPS2022_f8870955,
    author = {Piedboeuf, Fr\'{e}d\'{e}ric and Langlais, Philippe},
    booktitle = {Advances in Neural Information Processing Systems},
    editor = {S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh},
    pages = {38046--38059},
    publisher = {Curran Associates, Inc.},
    title = {A new dataset for multilingual keyphrase generation},
    url = {https://proceedings.neurips.cc/paper_files/paper/2022/file/f88709551258331f9ab31b33c71021a4-Paper-Datasets_and_Benchmarks.pdf},
    volume = {35},
    year = {2022}
}
---
license: apache-2.0
pretty_name: Papyrus
size_categories:
- 10K<n<100K
language:
- en
- fr
multilinguality: multilingual
tags:
- text-to-text
- keyphrase-generation
---

# Dataset Card for Papyrus

- **Paper:** [A new dataset for multilingual keyphrase generation](https://proceedings.neurips.cc/paper_files/paper/2022/hash/f88709551258331f9ab31b33c71021a4-Abstract-Datasets_and_Benchmarks.html)
- **Github:** <https://github.com/smolPixel/French-keyphrase-generation>


## Dataset Description

### Dataset Summary

The datasets are derived from Papyrus, a repository at Université de Montréal containing various types of documents, mainly theses with abstracts in multiple languages, primarily French and English. The entries are provided in four different configurations based on the languages of abstracts, allowing for generating keyphrases in French, English, or multiple languages.
- **Papyrus-f:** From the French abstracts, generate French keyphrases.
- **Papyrus-e:** From the English abstracts, generate English keyphrases.
- **Papyrus-m:** From one abstract in any language, generate keyphrases in that same
language (one language to one language).
- **Papyrus-a:** From the multiple abstracts of a document, generate keyphrases in the
same languages as the abstracts (many to many languages).

### Languages

- **Main languages:** English, French
- **Others:** Spanish, German, Italian, Portuguese, Arabic, Tagalog, Catalan, Greek, Turkish, Russian, Polish, Farsi, Indonesian, Lingala, Swedish, Finnish, Romanian, Korean


## Dataset Structure

### Dataset content

| Config    | Train set size | Valid. set size | Test set size |
| --------- | -------------- | --------------- | ------------- |
| papyrus-m | 20963          | 3040            | 6061          |
| papyrus-e | 10508          | 1539            | 3046          |
| papyrus-f | 10299          | 1488            | 2981          |
| papyrus-a | 11290          | 1638            | 3261          |

### Data fields

- **doc_id:** a unique id for the original document.
- **title:** title of the thesis or article (the language of the title does not always match the language of the abstract/keyphrases).
- **input_text:** abstract of the document.
- **keyphrases:** associated keyphrases.
- **lang:** language of the abstract/keyphrases.


## Citation

    @inproceedings{NEURIPS2022_f8870955,
        author = {Piedboeuf, Fr\'{e}d\'{e}ric and Langlais, Philippe},
        booktitle = {Advances in Neural Information Processing Systems},
        editor = {S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh},
        pages = {38046--38059},
        publisher = {Curran Associates, Inc.},
        title = {A new dataset for multilingual keyphrase generation},
        url = {https://proceedings.neurips.cc/paper_files/paper/2022/file/f88709551258331f9ab31b33c71021a4-Paper-Datasets_and_Benchmarks.pdf},
        volume = {35},
        year = {2022}
    }