annotations_creators:expert-generated language_creators:found multilinguality:monolingual size_categories:unknown language:ca license:mit region:us
CEIL (Catalan Entity Identification and Linking).
                  This is a dataset for complex Named Eentity Reacognition (NER) created by the AINA project in the BSC for 
                  Machine Learning and Language Model evaluation purposes.
                  
                  CEIL corpus is used under [CC-by] (https://creativecommons.org/licenses/by/4.0/) licence.
                  This dataset was developed by BSC as part of the AINA project, and to enrich the Catalan Language Understanding Benchmark (CLUB).
---
annotations_creators:
- expert-generated
language_creators:
- found
language:
- ca
license:
- mit
multilinguality:
- monolingual
pretty_name: ceil
size_categories:
- unknown
source_datasets: []
task_categories: []
task_ids: []
---

# Dataset Card for CEIL
 
## Dataset Description

- **Website:** https://aina.bsc.es
- **Point of Contact:** [Carlos Rodríguez-Penagos](carlos.rodriguez1@bsc.es)

### Dataset Summary

(Catalan Entity Identification and Linking).This is a dataset for complex Named Entity Recognition (NER) created by the AINA project in the BSC for  Machine Learning and Language Model evaluation purposes in Catalan. It contains 9 main types and 52 subtypes on all kinds of short texts, with almost 59K  documents. 

[CEIL corpus] is used under [CC-by](https://creativecommons.org/licenses/by/4.0/) licence. 

This dataset was developed by [BSC LangTech Unit](https://langtech.bsc.es/) as part of the [Projecte AINA](https://politiquesdigitals.gencat.cat/ca/economia/catalonia-ai/aina/), to enrich the [Catalan Language Understanding Benchmark (CLUB)](https://club.aina.bsc.es/).


![Prodigy Example](https://huggingface.co/datasets/crodri/ceil/resolve/main/Selection_021.png "Prodigy Example")

### Supported Tasks and Leaderboards

Named Entities Recognition, Language Model

### Languages

The dataset is in Catalan (`ca-ES`).

## Dataset Structure

### Data Instances

Three two-column files, one for each split. 

<pre>
l'      O
obra    O
de      O
Galileu B-person-scholar/scientist
,       O
i       O
de      O
la      O
multiplicació   O
de      O
les     O
acadèmies       O
científiques    O
,       O
com     O
l'      O
Accademia       B-organization-education
dei     I-organization-education
Lincei  I-organization-education
</pre>

### Data Fields

Every file has two columns, with the word form or punctuation symbol in the first one and the corresponding IOB tag in the second one.

### Data Splits

80/20 Train and development sets, balanced for all NERC tags. Test set incloudes documents that contain overall all the possible types in the corpus.


## Dataset Creation

### Curation Rationale

We created this corpus to contribute to the development of language models in Catalan.

### Source Data

Documents were gathered from various online sources:

- Tweets about different topics, such as catalan independence, coronavirus, benidormfest, vaccines, etc.
- Newswire from nacio digital (Motor) Vilaweb (opinion pieces), Agencia Catalana de Noticies (Economy and Memoria Histórica)
- Various threads from RacoCatalá forum
- Viquipedia articles (woman bios, film synopses, etc.)
- OTHER: Parliament proceedings, restaurant online reviews, etc.

#### Initial Data Collection and Normalization

The word tokenization used to convert offset annotations into CONLL files was done using spacy

#### Who are the source language producers?

Annotation Subcontracted to M47Labs.

Guidelines available at [Zenodo] (https://doi.org/10.5281/zenodo.8318188)

### Annotations

#### Annotation process

We adapted the NER labels from  to a token-per-line, multi-column format. 

#### Who are the annotators?

Original annotators from 

### Personal and Sensitive Information

No personal or sensitive information included.

## Considerations for Using the Data

### Social Impact of Dataset

We hope this corpus contributes to the development of language models in Catalan, a low-resource language.

### Discussion of Biases

[N/A]

### Other Known Limitations

[N/A]

## Additional Information
### Dataset Curators



This work was funded by the [Departament de la Vicepresidència i de Polítiques Digitals i Territori de la Generalitat de Catalunya](https://politiquesdigitals.gencat.cat/en/inici/index.html) within the framework of [Projecte AINA](https://politiquesdigitals.gencat.cat/ca/economia/catalonia-ai/aina/).

### Licensing information

This work is licensed under a <a rel="license" href="https://creativecommons.org/licenses/by/4.0/">Attribution 4.0 International License</a>.

### Citation Information

```


```





### Contributions

[N/A]
