task_categories:text-generation task_categories:fill-mask task_categories:text2text-generation task_ids:language-modeling task_ids:masked-language-modeling annotations_creators:no-annotation language_creators:found size_categories:1B<n<10B language:pt license:unknown region:us
---
pretty_name: CC-News-PT
annotations_creators:
- no-annotation
language_creators:
- found
language:
- pt
license:
- unknown
size_categories:
- 1B<n<10B
task_categories:
- text-generation
- fill-mask
- text2text-generation
task_ids:
- language-modeling
- masked-language-modeling
---
### Dataset Summary

CC-News-PT is a curation of news articles from CommonCrawl News in the Portuguese language.  
CommonCrawl News is a dataset containing news articles from news sites all over the world.  
The data is available on AWS S3 in the Common Crawl bucket at /crawl-data/CC-NEWS/.  
This version of the dataset is the portuguese subset from [CloverSearch/cc-news-mutlilingual](https://huggingface.co/datasets/CloverSearch/cc-news-mutlilingual).

### Data Fields

- `title`: a `string` feature.
- `text`: a `string` feature.
- `authors`: a `string` feature.
- `domain`: a `string` feature.
- `date`: a `string` feature.
- `description`: a `string` feature.
- `url`: a `string` feature.
- `image_url`: a `string` feature.
- `date_download`: a `string` feature.

### How to use this dataset

```python
from datasets import load_dataset
dataset = load_dataset("eduagarcia/cc_news_pt", split="train")
```

### Cite

```
@misc{Acerola2023,
    author = {Garcia, E.A.S.},
    title = {Acerola Corpus: Towards Better Portuguese Language Models},
    year = {2023},
    doi = {10.57967/hf/0814}
}
```