GPTQ 4 bit CUDA quantization of CalderaAI's 30B Lazarus:
https://huggingface.co/CalderaAI/30B-Lazarus
{}
transformers pytorch llama text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

GPTQ 4 bit CUDA quantization of CalderaAI's 30B Lazarus:
URL
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
