task_categories:translation language:eng language:afr language:nbl language:xho language:zul language:sot language:nso language:tsn language:ssw language:ven language:tso license:mit multilingual arxiv:2303.03750 region:us
---
language: 
- eng
- afr
- nbl
- xho
- zul
- sot
- nso
- tsn
- ssw
- ven
- tso
pretty_name: "The Gov South African Multilingual Corpus"
tags:
- multilingual
license: mit
task_categories:
- translation
arxiv: 2303.03750
---

# The South African Gov-ZA multilingual corpus

## About Dataset
The data set contains cabinet statements from the South African government, maintained by the [Government Communication and Information System (GCIS)](https://www.gcis.gov.za/). Data was scraped from the governments website:
https://www.gov.za/cabinet-statements

The datasets contain government cabinet statements in 11 languages, namely:

| Language   | Code | Language  | Code  |
| ---------- | ---- | --------- | ----- |
| Afrikaans  | (af) | Setswana  | (tn)  |
| English    | (en) | Sepedi    | (nso) |
| Sesotho    | (st) | Siswati   | (ss)  |
| isiNdebele | (nr) | Tshivenda | (ve)  |
| isiXhosa   | (xh) | Xitstonga | (ts)  |
| isiZulu    | (zu) | 
**Note:** The code is assigned from the GCIS website, all codes except Sepedi (nso) follow the ISO 639-1 language code format, whereas Sepedi follwo the ISO 639-2 language code format.

The dataset is in JSON format as follows:
```
[
    {
        "title": "Title in English",
        "date": "DD MMM YYYY",
        "datetime": "YYYY-MM-DD", #sometimes a timestamp
        "url": "URL to original text",
        "en": {
            "text": "Cabinet",
            "title": "Title in translated language",
            "url": "URL to translated text"
        },
        "af" : {},
        . . . 
    }, 
    {},
    . . . 
]
```

Disclaimer
-------
This dataset contains machine-readable data extracted from online cabinet statements from the South African government, provided by the Government Communication Information System (GCIS). While efforts were made to ensure the accuracy and completeness of this data, there may be errors or discrepancies between the original publications and this dataset. No warranties, guarantees or representations are given in relation to the information contained in the dataset. The members of the Data Science for Societal Impact Research Group bear no responsibility and/or liability for any such errors or discrepancies in this dataset. The Government Communication Information System (GCIS) bears no responsibility and/or liability for any such errors or discrepancies in this dataset. It is recommended that users verify all information contained herein before making decisions based upon this information.

## Authors

- Vukosi Marivate - [@vukosi](https://twitter.com/vukosi)
- Matimba Shingange
- Richard Lastrucci
- Isheanesu Joseph Dzingirai
- Jenalea Rajab

## Citation

**Paper**

[Preparing the Vuk'uzenzele and ZA-gov-multilingual South African  multilingual corpora](https://arxiv.org/pdf/2303.03750)

> @inproceedings{lastrucci-etal-2023-preparing,
    title = "Preparing the Vuk{'}uzenzele and {ZA}-gov-multilingual {S}outh {A}frican multilingual corpora",
    author = "Richard Lastrucci and Isheanesu Dzingirai and Jenalea Rajab and Andani Madodonga and Matimba Shingange and Daniel Njini and Vukosi Marivate",
    booktitle = "Proceedings of the Fourth workshop on Resources for African Indigenous Languages (RAIL 2023)",
    month = may,
    year = "2023",
    address = "Dubrovnik, Croatia",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.rail-1.3",
    pages = "18--25"
}

**Dataset**

Vukosi Marivate, Matimba Shingange, Richard Lastrucci, Isheanesu Joseph Dzingirai, Jenalea Rajab. **The South African Gov-ZA multilingual corpus**, 2022

> @dataset{marivate_vukosi_2023_7635168,
  author       = {Marivate, Vukosi and
                  Shingange, Matimba and
                  Lastrucci, Richard and
                  Dzingirai, Isheanesu and
                  Rajab, Jenalea},
  title        = {The South African Gov-ZA multilingual corpus},
  month        = feb,
  year         = 2023,
  publisher    = {Zenodo},
  version      = {1.0},
  doi          = {10.5281/zenodo.7635168},
  url          = {https://doi.org/10.5281/zenodo.7635168}
}


## Licences

* License for Data - [CC 4.0 BY](LICENSE_data.md)
* Licence for Code - [MIT License](LICENSE)
