dranger003 commited on
Commit
add14ac
1 Parent(s): 9fb1bf2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -4,4 +4,8 @@ library_name: gguf
4
  pipeline_tag: text-generation
5
  ---
6
  GGUF importance matrix (imatrix) quants for https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
7
- The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
 
 
 
 
 
4
  pipeline_tag: text-generation
5
  ---
6
  GGUF importance matrix (imatrix) quants for https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
7
+ The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
8
+
9
+ | Layers | Context | Template |
10
+ | --- | --- | --- |
11
+ | <pre>32</pre> | <pre>32768</pre> | <pre>[INST] {prompt} [/INST]<br>{response}</pre> |