language:id license:cc-by-nc-nd-4.0 region:us
---
language: id
license: cc-by-nc-nd-4.0
extra_gated_prompt: 'By accessing this dataset, you agree to abide by the BigScience
  Ethical Charter. The charter can be found at:

  https://hf.co/spaces/bigscience/ethical-charter'
extra_gated_fields:
  I have read and agree to abide by the BigScience Ethical Charter: checkbox
---
ROOTS Subset: roots_id_ted_talks_iwslt

# WIT Ted Talks

- Dataset uid: `ted_talks_iwslt`

### Description

The Web Inventory Talk is a collection of the original Ted talks and their translated version. The translations are available in more than 109+ languages, though the distribution is not uniform.

### Homepage

https://github.com/huggingface/datasets/blob/master/datasets/ted_talks_iwslt/README.md

### Licensing

- open license
- cc-by-nc-4.0: Creative Commons Attribution Non Commercial 4.0 International

TED makes its collection of video recordings and transcripts of talks available under the Creative Commons BY-NC-ND license (look here). WIT3 acknowledges the authorship of TED talks (BY condition) and does not redistribute transcripts for commercial purposes (NC). As regards the integrity of the work (ND), WIT3 only changes the format of the container, while preserving the original contents. WIT3 aims to support research on human language processing as well as the diffusion of TED Talks!


### Speaker Locations

- Southern Europe
- Italy


### Sizes

- 0.0305 % of total
- 0.0736 % of ar
- 0.2002 % of pt
- 0.0128 % of zh
- 0.2236 % of vi
- 0.0330 % of fr
- 0.0545 % of es
- 0.0122 % of en
- 0.3704 % of id
- 0.0373 % of indic-hi
- 0.0330 % of indic-ta
- 0.1393 % of indic-mr
- 0.0305 % of ca
- 0.1179 % of indic-ur
- 0.0147 % of indic-bn
- 0.0240 % of indic-ml
- 0.0244 % of indic-te
- 0.0503 % of indic-gu
- 0.0211 % of indic-kn
- 0.0274 % of eu
- 0.0023 % of indic-as
- 0.0001 % of indic-pa

### BigScience processing steps

#### Filters applied to: ar

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: pt

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: zh

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: vi

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: fr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: es

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: en

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: id

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-hi

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ta

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-mr

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: ca

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_1024

#### Filters applied to: indic-ur

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-bn

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-ml

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-te

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-gu

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: indic-kn

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

#### Filters applied to: eu

- dedup_document
- filter_remove_empty_docs

#### Filters applied to: indic-as

- dedup_document
- filter_remove_empty_docs

#### Filters applied to: indic-pa

- dedup_document
- filter_remove_empty_docs
- filter_small_docs_bytes_300

