transformers gguf mistral quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit GGUF pytorch safetensors mixtral text-generation mteb conversational custom_code dataset:GritLM/tulu2 arxiv:2402.09906 license:apache-2.0 model-index autotrain_compatible endpoints_compatible text-generation-inference region:us base_model:GritLM/GritLM-8x7B base_model:quantized:GritLM/GritLM-8x7B
{"model_type": "mistral"}