metadata
base_model: mistralai/Mistral-7B-Instruct-v0.2
model_creator: Mistral AI
model_name: Mistral 7B Instruct v0.2
model_type: mistral
pipeline_tag: text-generation
prompt_template: |
<s>[INST]{prompt} [/INST]
quantized_by: Rocwo
license: apache-2.0
Description
Quantified mistralai/Mistral-7B-Instruct-v0.2 into Q8_0 and converted to LLaMa CPP (GGUF) format.
About GGUF
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
Prompt template: ChatML
Prompt template: Mistral
<s>[INST] {prompt} [/INST]