Edit model card

EXL2 Quantization of Undi95's's Xwin-MLewd-13B-V0.2.

Model details

Quantized at 5.33bpw

3.73bpw

4.33bpw

6.13bpw

8.13bpw

Prompt Format

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
Downloads last month
16
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including R136a1/Xwin-MLewd-13B-V0.2-exl2