|
--- |
|
base_model: mistralai/Mistral-7B-Instruct-v0.2 |
|
model_creator: Mistral AI |
|
model_name: Mistral 7B Instruct v0.2 |
|
model_type: mistral |
|
pipeline_tag: text-generation |
|
prompt_template: '<s>[INST]{prompt} [/INST] |
|
|
|
' |
|
quantized_by: Rocwo |
|
license: apache-2.0 |
|
--- |
|
|
|
<!-- header start --> |
|
<!-- 200823 --> |
|
## Description |
|
|
|
Quantified [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) into Q8_0 and converted to LLaMa CPP (GGUF) format. |
|
|
|
### About GGUF |
|
|
|
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. |
|
|
|
## Prompt template: ChatML |
|
|
|
<!-- prompt-template start --> |
|
## Prompt template: Mistral |
|
|
|
``` |
|
<s>[INST] {prompt} [/INST] |
|
``` |
|
|
|
<!-- prompt-template end --> |
