language:ur license:cc-by-nc-sa-3.0 region:us
---
language: ur
license: cc-by-nc-sa-3.0
extra_gated_prompt: 'By accessing this dataset, you agree to abide by the BigScience
  Ethical Charter. The charter can be found at:

  https://hf.co/spaces/bigscience/ethical-charter'
extra_gated_fields:
  I have read and agree to abide by the BigScience Ethical Charter: checkbox
---
ROOTS Subset: roots_indic-ur_urdu-monolingual-corpus

# urdu-monolingual-corpus

- Dataset uid: `urdu-monolingual-corpus`

### Description

We release a sizeable monolingual Urdu corpus automatically tagged with part-of-speech tags. We extend the work of Jawaid and Bojar (2012) who use three different taggers and then apply a voting scheme to disambiguate among the different choices suggested by each tagger. We run this complex ensemble on a large monolingual corpus and release the both plain and tagged corpora.


### Homepage

https://www.kaggle.com/Cornell-University/arxiv

### Licensing

Mixed

### Speaker Locations



### Sizes

- 0.0419 % of total
- 14.8201 % of indic-ur

### BigScience processing steps

#### Filters applied to: indic-ur

- dedup_document
- dedup_template_soft
- filter_remove_empty_docs
- filter_small_docs_bytes_300

