language:id license:cc-by-nc-sa-4.0 region:us
---
language: id
license: cc-by-nc-sa-4.0
extra_gated_prompt: 'By accessing this dataset, you agree to abide by the BigScience
  Ethical Charter. The charter can be found at:

  https://hf.co/spaces/bigscience/ethical-charter'
extra_gated_fields:
  I have read and agree to abide by the BigScience Ethical Charter: checkbox
---
ROOTS Subset: roots_id_indo4b_jw300

# indo4b_jw300

- Dataset uid: `indo4b_jw300`

### Description

Indo4B consists of around 4B words, with around 250M sentences. The dataset covers both formal and colloquial Indonesian sentences compiled from 12 corpus, of which two corpus cover Indonesian colloquial language, eight corpus cover formal Indonesian language, and the rest have a mixed style, both colloquial and formal.\n

### Homepage

https://www.indobenchmark.com/

### Licensing

MIT License

### Speaker Locations



### Sizes

- 0.0045 % of total
- 1.7307 % of id

### BigScience processing steps

#### Filters applied to: id

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- KILL
- filter_small_docs_bytes_300

