--- base_model: mistralai/Mistral-7B-Instruct-v0.2 license: apache-2.0 inference: false model_creator: Mistral AI_ model_name: Mistral-7B-Instruct-v0.2 quantized_by: Leliuga pipeline_tag: text-generation tags: - mistral --- # Mistral-7B-Instruct-v0.2 - bnb 4bit - Model creator: [Mistral AI_](https://huggingface.co/mistralai) - Original model: [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) ## Description This model is 4bit quantized version of [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.