---
base_model: mistralai/Mistral-7B-Instruct-v0.2
model_creator: Mistral AI
model_name: Mistral 7B Instruct v0.2
model_type: mistral
pipeline_tag: text-generation
prompt_template: '<s>[INST]{prompt} [/INST]

  '
quantized_by: Rocwo
license: apache-2.0
---

<!-- header start -->
<!-- 200823 -->
## Description

Quantified [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) into Q8_0 and converted to LLaMa CPP (GGUF) format.

### About GGUF

GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.

## Prompt template: ChatML

<!-- prompt-template start -->
## Prompt template: Mistral

```
<s>[INST] {prompt} [/INST]
```

<!-- prompt-template end -->