Hugging Face's logo

Kooten
/
Noromaid-13b-v0.2-6bpw-exl2

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

This is a 6BPW EXL2 quant of Noromaid-13b-v0.2

Exllama 2 quant of NeverSleep/Noromaid-13b-v0.2

Prompt template: Custom format, or Alpaca

Custom format:

SillyTavern config files: Context, Instruct.

Alpaca: 

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
Downloads last month
6
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including Kooten/Noromaid-13b-v0.2-6bpw-exl2