digitous
/

13B-HyperMantis_GPTQ_4bit-128g

Text Generation

Inference Endpoints

Model card Files Files and versions Community

13B-HyperMantis_GPTQ_4bit-128g / README.md

digitous's picture

Create README.md

eab8de2 over 1 year ago

|

history blame contribute delete

140 Bytes

metadata

tags:
  - llama
  - alpaca
  - mix
  - gptq
  - quant

GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis