transformers gguf mistral facebook meta pytorch llama llama-3 quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit 16-bit GGUF text-generation en base_model:meta-llama/Meta-Llama-3-8B-Instruct base_model:quantized:meta-llama/Meta-Llama-3-8B-Instruct text-generation-inference region:us conversational
{"model_type": "mistral"}