Suparious commited on
Commit
0eed910
1 Parent(s): 3ebfe1d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -2
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
 
2
  library_name: transformers
3
  tags:
4
  - 4-bit
@@ -6,10 +7,36 @@ tags:
6
  - text-generation
7
  - autotrain_compatible
8
  - endpoints_compatible
 
9
  pipeline_tag: text-generation
10
  inference: false
11
  quantized_by: Suparious
12
  ---
13
- #
14
 
15
- **UPLOAD IN PROGRESS**
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
  library_name: transformers
4
  tags:
5
  - 4-bit
 
7
  - text-generation
8
  - autotrain_compatible
9
  - endpoints_compatible
10
+ - finetuned
11
  pipeline_tag: text-generation
12
  inference: false
13
  quantized_by: Suparious
14
  ---
15
+ # mistralai/Mistral-7B-Instruct-v0.2 AWQ
16
 
17
+ - Model creator: [mistralai](https://huggingface.co/mistralai)
18
+ - Original model: [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
19
+
20
+ ## Model Summary
21
+
22
+ The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.
23
+
24
+ Mistral-7B-v0.2 has the following changes compared to Mistral-7B-v0.1
25
+ - 32k context window (vs 8k context in v0.1)
26
+ - Rope-theta = 1e6
27
+ - No Sliding-Window Attention
28
+
29
+ For full details of this model please read our [paper](https://arxiv.org/abs/2310.06825) and [release blog post](https://mistral.ai/news/la-plateforme/).
30
+
31
+ ## Instruction format
32
+
33
+ In order to leverage instruction fine-tuning, your prompt should be surrounded by `[INST]` and `[/INST]` tokens. The very first instruction should begin with a begin of sentence id. The next instructions should not. The assistant generation will be ended by the end-of-sentence token id.
34
+
35
+ E.g.
36
+ ```
37
+ text = "<s>[INST] What is your favourite condiment? [/INST]"
38
+ "Well, I'm quite partial to a good squeeze of fresh lemon juice. It adds just the right amount of zesty flavour to whatever I'm cooking up in the kitchen!</s> "
39
+ "[INST] Do you have mayonnaise recipes? [/INST]"
40
+ ```
41
+
42
+ This format is available as a [chat template](https://huggingface.co/docs/transformers/main/chat_templating) via the `apply_chat_template()` method.