llmixer
/

c4ai-command-r-plus-5.9bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

c4ai-command-r-plus-5.9bpw-h8-exl2 / README.md

llmixer's picture

Create README.md

70638fd verified 4 months ago

|

history blame contribute delete

No virus

248 Bytes

metadata

pipeline_tag: text-generation

5.90 bpw exl2 quant of c4ai-command-r-plus

Fits in 96 GB VRAM with 20k context.

More quants: https://huggingface.co/turboderp/command-r-plus-103B-exl2