GGUF
Composer
MosaicML
llm-foundry

More recent mpt model variants quantized at maddes8cht

#3
by maddes8cht - opened

A full set of all possible gguf quantizations of mpt 7b and 30b, instruct, chat etc. is available at maddes8cht.
There is a collection just for the mpt-models.
And, as mosaic has updated their mpt models recently, the models there are already up to date with the current mpt release.

Sign up or log in to comment