GGUF small language models
Collection
LMs of 8B parameters or less. Quantized in 8bit and 4bit representations, and converted to GGUF.
•
29 items
•
Updated
jxtngx/Hermes-2-Pro-Mistral-7B-Q4_K_S-GGUF
This model was converted to GGUF format from NousResearch/Hermes-2-Pro-Mistral-7B using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
- Downloads last month
- 4
Model tree for jxtngx/Hermes-2-Pro-Mistral-7B-Q4_K_S-GGUF
Base model
mistralai/Mistral-7B-v0.1
Finetuned
NousResearch/Hermes-2-Pro-Mistral-7B
Quantized
this model