task_categories:translation task_categories:text-classification task_categories:summarization task_categories:sentence-similarity size_categories:100K<n<1M language:en language:cy license:other region:us
---
license: other
task_categories:
- translation
- text-classification
- summarization
- sentence-similarity
language:
- en
- cy
pretty_name: Cofnod Y Cynulliad en-cy
size_categories:
- 100K<n<1M
---
# Dataset Card for cofnodycynulliad_en-cy

## Dataset Description

- **Homepage:** https://github.com/techiaith/cofnod-y-cynulliad_dataset
- **Repository:** https://github.com/techiaith/cofnod-y-cynulliad_dataset.git
- **Point of Contact:** techiaith@bangor.ac.uk

### Dataset Summary

This dataset consists of English-Welsh sentence pairs obtained by parsing the data provided from the [Welsh Parliament](https://cofnod.senedd.cymru/) website.

### Supported Tasks and Leaderboards

- translation
- text classification
- sentence similarity

### Languages

- English
- Welsh

## Dataset Structure

### Data Fields

- source
- target

### Data Splits

- train

## Dataset Creation

The dataset was created via an internal pipeline employing DVC and Python.

### Source Data

#### Initial Data Collection and Normalization

Sentences were dropped from the original scrapped sources in the following cases:

- sentence contained too many misspelt words
- sentence length similarity variance too great.

#### Who are the source language producers?

The language data, including source and target language data, is derived from transcripts of the proceedings of the Senedd's Plenary meetings and their translations. 
See [here](https://cofnod.senedd.cymru) for information.

### Licensing Information
This dataset's source data is Crown copyright and is licensed under the [Open Government License](https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/).