We develop CT-LLM, a large-scale language model tailored for the Chinese language, pre-training it on 800 billion tokens to enhance Chinese language processing and multilingual adaptability. Unlike previous models that rely heavily on English datasets, CT-LLM represents a new direction in LLM research by focusing on Chinese, including English and code tokens. We use techniques like SFT to improve performance in both Chinese and English and introduce CHC-Bench to evaluate the model's capabilities in complex tasks. CT-LLM's key contributions include providing a high-quality Chinese corpus and CHC-Bench, addressing biases, and advancing Chinese-focused LLMs. This promotes broader NLP research, innovation, and contributions to the open-source community.