task_categories:translation task_categories:text-classification task_categories:summarization task_categories:sentence-similarity size_categories:100M<n<1B language:en language:cy license:other region:us
---
license: other
task_categories:
- translation
- text-classification
- summarization
- sentence-similarity
language:
- en
- cy
pretty_name: UK Government Legislation
size_categories:
- 100M<n<1B
---

# Dataset Card for legislation-gov-uk-en-cy

## Dataset Description

- **Homepage:**  https://github.com/techiaith/legislation-gov-uk_dataset
- **Repository:** https://github.com/techiaith/legislation-gov-uk_dataset
- **Point of Contact:** techiaith@bangor.ac.uk

### Dataset Summary

This dataset consists of English-Welsh sentence pairs obtained via scraping the www.legislation.gov.uk website. 
 
The total dataset is approximately 170 Mb in size.

### Supported Tasks and Leaderboards

- translation
- text-classification
- summarization
- sentence-similarity

### Languages

- English
- Welsh

## Dataset Structure

### Data Fields

- source
- target

### Data Splits

- train

## Dataset Creation

English-Welsh sentence pairs were obtained by scraping the www.legislation.gov.uk website and then cleaning the data using an internal processing pipeline.

### Source Data

#### Initial Data Collection and Normalization

Sentences were dropped from the original scrapped sources in the following cases:

- sentence contained too many misspelt words
- sentence length similarity variance too great.

#### Who are the source language producers?

The language data, including source and target language data, is derived from UK legislation. See [here](https://www.legislation.gov.uk/aboutus) for information.

### Licensing Information
This dataset's source data is Crown copyright and is licensed under the [Open Government License](https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/).