JayhC
/

L3-ChaoticSoliloquy-v1.5-4x8B-8bpw-h8-exl2

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

JayhC commited on May 3

Commit

344dcc5

•

1 Parent(s): c05a0aa

Update README.md

Files changed (1) hide show

README.md +7 -0

README.md CHANGED Viewed

@@ -6,6 +6,13 @@ language:
 - en
 ---
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/m5urYkrpE5amrwHyaVwFM.png)
 > [!IMPORTANT]

 - en
 ---
+<br/><br/>
+8bpw/h8 exl2 quantization of [xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B](https://huggingface.co/xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B) using default exllamav2 calibration dataset.
+---
+**ORIGINAL CARD:**
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/m5urYkrpE5amrwHyaVwFM.png)
 > [!IMPORTANT]