second-state
/

Mixtral-8x7B-Instruct-v0.1-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions Community

apepkuss79 commited on Mar 20

Commit

eb63237

•

1 Parent(s): 86892f0

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -43,6 +43,8 @@ quantized_by: Second State Inc.
     <s> [INST] {user_message_1} [/INST] {assitant_message_1}</s> [INST] {user_message_2} [/INST]
     ```
 - Run as LlamaEdge service
   ```bash

     <s> [INST] {user_message_1} [/INST] {assitant_message_1}</s> [INST] {user_message_2} [/INST]
     ```
+- Context size: `4096`
 - Run as LlamaEdge service
   ```bash