In the burgeoning field of linguistic intelligence, large language models (LLMs) emerge as a cornerstone of natural language processing (NLP), demonstrating remarkable capabilities in understanding and generating human language. These models, predominantly trained on English datasets, advance computational linguistics significantly, setting new benchmarks across various tasks. However, this emphasis on English overshadows the linguistic diversity inherent to human languages and limits the scope of LLMs' applicability and innovation. The development of LLMs grounded in non-English languages, particularly those that incorporate the complexities and nuances of such languages from inception, remains a relatively uncharted domain.