Central to our research is the open-sourcing of the entire training process for CT-LLM, including the meticulous data processing procedures undertaken to curate the Massive Appropriate Pretraining Chinese Corpus (MAP-CC) and the establishment of the multidisciplinary Chinese Hard Case Benchmark (CHC-Bench). Through the dissemination of our methodologies and findings, we aim to foster a more inclusive and diverse landscape for future LLM developments, encouraging the exploration of models that better reflect the vast array of human languages and cultures.