Fig. 1: The trends of the cumulative numbers of arXiv papers that contain the keyphrases _“language model”_ (since June 2018) and _“large language model”_ (since October 2019), respectively. The statistics are calculated using exact match by querying the keyphrases in title or abstract by months. We set different x-axis ranges for the two keyphrases, because “language models” have been explored at an earlier time. We label the points corresponding to important landmarks in the research progress of LLMs. A sharp increase occurs after the release of ChatGPT: the average number of published arXiv papers that contain _“large language model”_ in title or abstract goes from 0.40 per day to 8.58 per day (Figure 1(b)).