GGUF
mistral / metadata.yaml
van-qa's picture
Update metadata.yaml
a18dea7 verified
raw
history blame contribute delete
No virus
173 Bytes
name: mistral
default:
- main: Q4_K_M
- gguf: Q4_K_M
- onnx: AWQ INT4
- tensorrt-llm: AWQ INT4
7b:
- gguf: Q4_K_M
- onnx: AWQ INT4
- tensorrt-llm: AWQ INT4