

GPTQ 4-bit no actor version for compatibility that works in textgen-webui

Generated by using scripts from https://gitee.com/yhyu13/llama_-tools

Original weights: https://huggingface.co/openaccess-ai-collective/manticore-13b

---

Manticore is by far the most satisfying LLaMA model I've used due to its fine-tuning datasets are generated from the best of Vicuna, Wizard, and ShareGPT/GPT4.

Here is a conversation generated in textgen-webui, it shows step by step Chain of Thoughts comments along side generating complex code sample in an engaging tone!

![sample](./img/sample.png)
{"license": "apache-2.0"}
transformers pytorch llama text-generation license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #license-apache-2.0 #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 



GPTQ 4-bit no actor version for compatibility that works in textgen-webui

Generated by using scripts from URL

Original weights: URL

---

Manticore is by far the most satisfying LLaMA model I've used due to its fine-tuning datasets are generated from the best of Vicuna, Wizard, and ShareGPT/GPT4.

Here is a conversation generated in textgen-webui, it shows step by step Chain of Thoughts comments along side generating complex code sample in an engaging tone!

!sample
TAGS
#transformers #pytorch #llama #text-generation #license-apache-2.0 #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
