Overview Generative Language Models (Updated 18 March 2023)
I am publishing this story given the increasing speed with which new generative Language Models have been published in the last few years. I hope this summary will help to orient in the many architectures that have been published so far. Cheers! Papers Links OPT, Galactica, LLama, GPT3, GPT-NeoX, T5, mT5, Flan-T5, T0, mT0, BLOOM, BLOOMZ, UL2, FlanUL2. PS: many of the open-sourced models’ weights can be found on HuggingFace 🤗!
Overview Generative Language Models (Updated 18 March 2023) I am publishing this story given the increasing speed with which new generative Language Models have been published in the last few years. I hope this summary will help to orient in the many architectures that have been published so far. Cheers! Papers Links OPT, Galactica, LLama, GPT3, GPT-NeoX, T5, mT5, Flan-T5, T0, mT0, BLOOM, BLOOMZ, UL2, FlanUL2. PS: many of the open-sourced models’ weights can be found on HuggingFace 🤗! nlp
Overview Generative Language Models Updated 18 March 2023 publishing story given increasing speed new generative Language Models published last year hope summary help orient many architecture published far Cheers Papers Links OPT Galactica LLama GPT3 GPTNeoX T5 mT5 FlanT5 T0 mT0 BLOOM BLOOMZ UL2 FlanUL2 PS many opensourced models’ weight found HuggingFace 🤗 nlp