Hugging Face's logo

alpindale
/
c4ai-command-r-plus-GPTQ

Text Generation
Transformers
Safetensors
cohere
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
6
New discussion

VRAM requirement

3
#5 opened 7 months ago by jithinmukundan

Can VLLM be used for loading?

6
#4 opened 7 months ago by wawoshashi

How many bits and what is the groupsize?

1
#3 opened 7 months ago by vitvit

What library was used to quantize the model?

1
#2 opened 7 months ago by KirillR

How to load command r+ in text-generation-webui?

5
#1 opened 7 months ago by MLDataScientist