GGUF
English
Inference Endpoints
Edit model card

Some GGUF v2 quantizations of the model harborwater/wizard-orca-3b

It was trained on 2 epoch of pankajmathur's WizardLM_orca dataset.

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>
Downloads last month
139
GGUF
Model size
3.43B params
Architecture
llama

4-bit

5-bit

Inference API
Unable to determine this model's library. Check the docs .

Dataset used to train Aryanne/Wizard-Orca-3B-gguf

Spaces using Aryanne/Wizard-Orca-3B-gguf 6