Faced with both opportunities and challenges, it needs more attention on the research and development of LLMs. Inorder to provide a basic understanding of LLMs, this survey conducts a literature review of the recent advances in LLMs from four major aspects, including _pre-training_ (how to pre-train a capable LLM), _adaptation_ (how to effectively adapt pre-trained LLMs for better use), _utilization_ (how to use LLMs for solving various downstream tasks) and _capability evaluation_ (how to evaluate the abilities of LLMs and existing empirical findings). We thoroughly comb the literature and summarize the key findings, techniques, and methods of LLMs. For this survey, we also create a GitHub project website by collecting the supporting resources for LLMs, at the link [https://github.com/RUCAlBox/LLMSurvey](https://github.com/RUCAlBox/LLMSurvey). We are also aware of several related review articles on PLMs or LLMs [32, 36, 38, 39, 43, 48, 49, 50, 51, 52, 53, 54]. These papers either discuss PLMs or some specific (or general) aspects of LLMs. Compared with them, we focus on the techniques and methods to develop and use LLMs and provide a relatively comprehensive reference to important aspects of LLMs.