evaldas-leliuga's picture
Update README.md
99be5b4 verified
---
base_model: mistralai/Mistral-7B-Instruct-v0.1
license: apache-2.0
inference: false
model_creator: Mistral AI_
model_name: Mistral-7B-Instruct-v0.1
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
- mistral
- arxiv:2310.06825
- arxiv:1910.09700
---
# Mistral-7B-Instruct-v0.1 - bnb 4bit
- Model creator: [Mistral AI_](https://huggingface.co/mistralai)
- Original model: [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1)
## Description
This model is 4bit quantized version of [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.