language:en license:mit region:us
---
language: en
license: mit
extra_gated_prompt: 'By accessing this dataset, you agree to abide by the BigScience
  Ethical Charter. The charter can be found at:

  https://hf.co/spaces/bigscience/ethical-charter'
extra_gated_fields:
  I have read and agree to abide by the BigScience Ethical Charter: checkbox
---
ROOTS Subset: roots_en_the_pile_europarl

# the_pile_europarl

- Dataset uid: `the_pile_europarl`

### Description



### Homepage



### Licensing



### Speaker Locations



### Sizes

- 0.1278 % of total
- 0.4112 % of fr
- 1.5555 % of pt
- 0.7511 % of es
- 0.1503 % of en

### BigScience processing steps

#### Filters applied to: fr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: pt

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: es

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: en

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

