File size: 691 Bytes
c7206f0
87301c2
c7206f0
87301c2
 
 
 
 
 
4cf85a1
 
 
c7206f0
87301c2
 
 
 
 
 
4cf85a1
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
---
base_model: mistralai/Mistral-7B-Instruct-v0.2
license: apache-2.0
inference: false
model_creator: Mistral AI_
model_name: Mistral-7B-Instruct-v0.2
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
- mistral
- arxiv:2310.06825
- arxiv:1910.09700
---
# Mistral-7B-Instruct-v0.2 - bnb 4bit
- Model creator: [Mistral AI_](https://huggingface.co/mistralai)
- Original model: [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)

## Description

This model is 4bit quantized version of [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.