language:zh region:us
---
language:
- zh
---

# Traditional Chinese C4

### Dataset Summary

Data obtained from 2023-14 Common Crawl. 


Downloaded and processed using [code](https://github.com/jedcheng/c4-dataset-script) based on another [project](https://github.com/shjwudp/c4-dataset-script) attempting to recreate the C4 dataset.


The resultant dataset contains both simplified and traditional Chinese. 
It was then filtered using a [modified list](https://github.com/jedcheng/c4-dataset-script/blob/master/SC_filter/SC_list.txt) of simplified Chinese characters to obtain [another traditional Chinese dataset](https://huggingface.co/datasets/jed351/Traditional-Chinese-Common-Crawl-Filtered).



I would like to acknowledge computational resources and support provided by the Imperial College Research Computing Service (http://doi.org/10.14469/hpc/2232)