GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis
{"tags": ["llama", "alpaca", "mix", "gptq", "quant"]}
transformers llama text-generation alpaca mix gptq quant autotrain_compatible endpoints_compatible has_space text-generation-inference region:us
TAGS
#transformers #llama #text-generation #alpaca #mix #gptq #quant #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 

GPTQ 4 bit 128 groupsize quantization of URL
TAGS
#transformers #llama #text-generation #alpaca #mix #gptq #quant #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
