SpectraSuite/QuantLM_3.9B_3bit_Unpacked
Text Generation
•
Updated
•
12
QuantLMs, unpacked to FP16 format - compatible with FP16 GEMMs. After unpacking, QuantLMs have the same architecture as LLaMa.