task_categories:text-generation task_ids:language-modeling annotations_creators:no-annotation language_creators:expert-generated multilinguality:monolingual size_categories:100K<n<1M source_datasets:original language:ca license:cc-by-sa-4.0 license:cc0-1.0 region:us
---
annotations_creators:
- no-annotation
language_creators:
- expert-generated
language:
- 'ca'
license:
- cc-by-sa-4.0
- cc0-1.0
multilinguality:
- monolingual
pretty_name: Softcatalà website content.
size_categories:
- "100K<n<1M"
source_datasets:
- original
task_categories:
- text-generation
task_ids:
- language-modeling
---
# Dataset Card for Softcatala-Web-Texts-Dataset
## Table of Contents
- [Table of Contents](#table-of-contents)
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)
## Dataset Description
- **Homepage:** https://www.softcatala.org/
- **Repository:** https://github.com/Softcatala/softcatala-web-dataset
- **Paper:**
- **Leaderboard:**
- **Point of Contact:**
### Dataset Summary
This repository contains Sofcatalà web site content (articles and programs descriptions).

Dataset size:
* articles.json contains 623 articles with 373233 words.
* programes.json contains 330 program descriptions with 49868 words.

The license of the data is Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) or Universal Public Domain Dedication (CC0 1.0)

### Supported Tasks and Leaderboards

### Languages
Catalan (`ca`).
## Dataset Structure
### Data Instances
[More Information Needed]
### Data Fields
JSON (name/value pairs) format with the following fields: content, date, id and title.
### Data Splits
One file for the descriptions text and one for the articles text.
## Dataset Creation
### Curation Rationale
[More Information Needed]
### Source Data
#### Initial Data Collection and Normalization
[More Information Needed]
#### Who are the source language producers?
Softcatalà community.
### Annotations
#### Annotation process
[More Information Needed]
#### Who are the annotators?
[More Information Needed]
### Personal and Sensitive Information
[More Information Needed]
## Considerations for Using the Data
### Social Impact of Dataset
[More Information Needed]
### Discussion of Biases
[More Information Needed]
### Other Known Limitations
[More Information Needed]
## Additional Information
### Dataset Curators
[@softcatala](https://github.com/Softcatala)
[@jordimas](https://github.com/jordimas)
### Licensing Information
[CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/).
[CC0-1.0](https://creativecommons.org/share-your-work/public-domain/cc0/).
### Citation Information
[More Information Needed]
### Contributions
[More Information Needed]
