language:ind pos-tagging region:us
Idn-tagged-corpus-CSUI is a POS tagging dataset contains about 10,000 sentences, collected from the PAN Localization Project tagged with 23 POS tag classes.
The POS tagset is created through a detailed study and analysis of existing tagsets and the manual tagging of an Indonesian corpus.
Idn-tagged-corpus-CSUI dataset is splitted into 3 sets with 8000 train, 1000 validation, 1029 test data.
@inproceedings{dinakaramani2014designing,
  title={Designing an Indonesian part of speech tagset and manually tagged Indonesian corpus},
  author={Dinakaramani, Arawinda and Rashel, Fam and Luthfi, Andry and Manurung, Ruli},
  booktitle={2014 International Conference on Asian Language Processing (IALP)},
  pages={66--69},
  year={2014},
  organization={IEEE}
}

@inproceedings{kurniawan2018towards,
  author={Kurniawan, Kemal and Aji, Alham Fikri},
  booktitle={2018 International Conference on Asian Language Processing (IALP)}, 
  title={Toward a Standardized and More Accurate Indonesian Part-of-Speech Tagging}, 
  year={2018},
  volume={},
  number={},
  pages={303-307},
  doi={10.1109/IALP.2018.8629236}}
---
tags:
- pos-tagging
language:
- ind
---

# idn_tagged_corpus_csui

Idn-tagged-corpus-CSUI is a POS tagging dataset contains about 10,000 sentences, collected from the PAN Localization Project tagged with 23 POS tag classes.

The POS tagset is created through a detailed study and analysis of existing tagsets and the manual tagging of an Indonesian corpus.

Idn-tagged-corpus-CSUI dataset is splitted into 3 sets with 8000 train, 1000 validation, 1029 test data.

## Dataset Usage

Run `pip install nusacrowd` before loading the dataset through HuggingFace's `load_dataset`.

## Citation

```
@inproceedings{dinakaramani2014designing,
  title={Designing an Indonesian part of speech tagset and manually tagged Indonesian corpus},
  author={Dinakaramani, Arawinda and Rashel, Fam and Luthfi, Andry and Manurung, Ruli},
  booktitle={2014 International Conference on Asian Language Processing (IALP)},
  pages={66--69},
  year={2014},
  organization={IEEE}
}

@inproceedings{kurniawan2018towards,
  author={Kurniawan, Kemal and Aji, Alham Fikri},
  booktitle={2018 International Conference on Asian Language Processing (IALP)}, 
  title={Toward a Standardized and More Accurate Indonesian Part-of-Speech Tagging}, 
  year={2018},
  volume={},
  number={},
  pages={303-307},
  doi={10.1109/IALP.2018.8629236}}
```

## License

Creative Commons Attribution Share-Alike 4.0 International

## Homepage

[https://bahasa.cs.ui.ac.id/postag/corpus](https://bahasa.cs.ui.ac.id/postag/corpus)

### NusaCatalogue

For easy indexing and metadata: [https://indonlp.github.io/nusa-catalogue](https://indonlp.github.io/nusa-catalogue)