Fig. 24: Timeline of some of the most representative LLM frameworks (so far). In addition to large language models with our #parameters threshold, we included a few representative works, which pushed the limits of language models, and paved the way for their success (e.g. vanilla Transformer, BERT, GPT-1), as well as some small language models. \(\clubsuit\) shows entities that serve not only as models but also as approaches. \(\clubsuit\) shows only approaches.