Fig. 4: A brief illustration for the technical evolution of GPT-series models. We plot this figure mainly based on the papers, blog articles and official APIs from OpenAI. Here, _solid lines_ denote that there exists an explicit evidence (_e.g.,_ the official statement that a new model is developed based on a base model) on the evolution path between two models, while _dashed lines_ denote a relatively weaker evolution relation.