starble-dev
/

mistral-dory-12b-gguf

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

starble-dev commited on Jul 23

Commit

d868c3e

•

1 Parent(s): f5108d8

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -9,10 +9,14 @@ library_name: transformers
 ---
 > [!WARNING]
-> **Sampling:**<br>
 > Mistral-Nemo-12B is very sensitive to the temperature sampler, try values near **0.3** at first or else you will get some weird results. This is mentioned by MistralAI at their [Transformers](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407#transformers) section. <br>
 > Flash-Attention seems to have seem weird effects with the model as well, however there is no confirmation on this.
 **Original Model:**
 [BeaverAI/mistral-dory-12b](https://huggingface.co/BeaverAI/mistral-dory-12b)

 ---
 > [!WARNING]
+> **Sampling:**
 > Mistral-Nemo-12B is very sensitive to the temperature sampler, try values near **0.3** at first or else you will get some weird results. This is mentioned by MistralAI at their [Transformers](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407#transformers) section. <br>
 > Flash-Attention seems to have seem weird effects with the model as well, however there is no confirmation on this.
+> [!IMPORTANT]
+> **IMPORTANT:**
+> Updated version of the model available here: [mistral-doryV2-12b-gguf](https://huggingface.co/starble-dev/mistral-doryV2-12b-gguf)
 **Original Model:**
 [BeaverAI/mistral-dory-12b](https://huggingface.co/BeaverAI/mistral-dory-12b)