language_creators:machine-generated size_categories:10K<n<100K source_datasets:glue language:pt arxiv:2305.06721 region:us
GLUE-PTPT is an European Portuguese translation of the GLUE benchmark using DeepL Pro.
@misc{Gomes2023,
  author = {Luís Gomes and João Rodrigues and João Silva and António Branco and Rodrigo Santos},
  title = {GLUE-PTPT -- The General Language Understanding Evaluation benchmark translated to European Portuguese},
  year = {2023},
  publisher = {Hugging Face},
  journal = {Hugging Face dataset},
  howpublished = {\\url{https://huggingface.co/datasets/PORTULAN/glue-ptpt}},
}
---
language:
- pt
language_creators:
- machine-generated
source_datasets:
  - glue
pretty_name: GLUE-PTPT -- The General Language Understanding Evaluation benchmark translated to European Portuguese
size_categories:
- 10K<n<100K
---

# GLUE-PTPT -- The General Language Understanding Evaluation benchmark translated to European Portuguese

This dataset has been created to evaluate [Albertina PT-* models](https://huggingface.co/PORTULAN/albertina-ptpt).

If you use this dataset please cite:

    @misc{rodrigues2023advancing,
      title={Advancing Neural Encoding of Portuguese with Transformer Albertina PT-*}, 
      author={João Rodrigues and Luís Gomes and João Silva and António Branco and Rodrigo Santos and Henrique Lopes Cardoso and Tomás Osório},
      year={2023},
      eprint={2305.06721},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
    }

Thus far, only 4 tasks have been translated to European Portuguese:

- MRPC
- RTE
- STS-B
- WNLI

The remainder tasks will be added in the future.


See [gluebenchmark.com](https://gluebenchmark.com/) for information about the General Language Understanding Evaluation (GLUE) dataset.


