language:id license:cc-by-4.0 region:us
---
language: id
license: cc-by-4.0
extra_gated_prompt: 'By accessing this dataset, you agree to abide by the BigScience
  Ethical Charter. The charter can be found at:

  https://hf.co/spaces/bigscience/ethical-charter'
extra_gated_fields:
  I have read and agree to abide by the BigScience Ethical Charter: checkbox
---
ROOTS Subset: roots_id_indo4b_talpco

# Indo4b

- Dataset uid: `indo4b_talpco`

### Description

A compiled Indonesian monolingual dataset. Includes OSCAR, OpenSub, and CommonCrawl

### Homepage

https://www.indobenchmark.com/

### Licensing

MIT License

### Speaker Locations

- South-eastern Asia
- Indonesia


### Sizes

- 0.0000 % of total
- 0.0018 % of id

### BigScience processing steps

#### Filters applied to: id

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- KILL
- filter_small_docs_bytes_300

