Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

8,975

Full-text search

Active filters: gguf-my-repo

hellork/calme-2.1-qwen2-7b-Q4_K_M-GGUF

Text Generation • Updated Sep 17 • 12 • 1

SteelTalon/nephra_v1.0-Q4_K_M-GGUF

Updated Aug 23 • 11 • 1

Triangle104/MN-12B-Starcannon-v3-Q4_K_M-GGUF

Updated 3 days ago • 32 • 1

Triangle104/MN-12B-Starcannon-v3-Q5_K_M-GGUF

Updated 3 days ago • 27 • 1

ywms666/gpt-neox-20b-fiction-novel-generation-Q4_K_M-GGUF

Text Generation • Updated Aug 30 • 41 • 1

onix331/L3-8B-Stheno-v3.2-Q6_K-GGUF

Updated Sep 3 • 19 • 1

Pelegoto/Honey-Yuzu-Mod-13B-Q5_K_M-GGUF

Updated Sep 5 • 5 • 2

bunnycore/HyperLlama3.1-v2-Q4_K_M-GGUF

Updated Sep 7 • 22 • 1

tianlp/flan-t5-large-Q4_K_M-GGUF

Text2Text Generation • Updated Sep 10 • 28 • 1

jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q8_0-GGUF

Text Generation • Updated Sep 12 • 60 • 2

jpacifico/Chocolatine-14B-Instruct-DPO-v1.2-Q4_K_M-GGUF

Text Generation • Updated Sep 12 • 69 • 4

RSpij/Saul-7B-Instruct-v1-Q4_K_M-GGUF

Updated Sep 12 • 73 • 1

hellork/Qwen2-7B-Multilingual-RP-IQ4_NL-GGUF

Updated Sep 17 • 7 • 1

Casual-Autopsy/L3-Luna-8B-iMat-GGUF

Updated Sep 18 • 54 • 2

xiaoheiqaq/Aya-v0.2-Q4_K_M-GGUF

Updated Sep 20 • 217 • 1

TheRains/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 19 • 39 • 1

Triangle104/Qwen2.5-14B-Q4_K_M-GGUF

Text Generation • Updated Sep 19 • 89 • 2

win10/Pixtral-12B-2409-hf-text-only-Q8_0-GGUF

Text Generation • Updated Sep 20 • 704 • 5

HigherMind/TalktoBooks-The-Odyssey-by-Homer-Q8_0-GGUF

Updated Sep 24 • 7 • 1

VlSav/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q4_K_M-GGUF

Updated Sep 22 • 711 • 7

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 3.15k • 13

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 304k • 15

darkc0de/Llama-3.2-3B-Instruct-abliterated-Q8_0-GGUF

Updated Sep 28 • 366 • 4

Orion-zhen/Meissa-Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 30 • 257 • 2

pcuenq/Qwen2.5-0.5B-Instruct-with-new-merges-serialization-Q8_0-GGUF

Text Generation • Updated Sep 30 • 24 • 3

ClaudioItaly/Templare-12B-Q4_K_M-GGUF

Updated Oct 2 • 1 • 2

hellork/law-chat-IQ4_XS-GGUF

Text Generation • Updated Oct 2 • 31 • 1

hellork/Indian_law_chat_minor_project-IQ4_XS-GGUF

Text2Text Generation • Updated Oct 2 • 2 • 1

Triangle104/Qwen2.5-7B-Instruct-abliterated-v2-Q4_K_M-GGUF

Text Generation • Updated Oct 17 • 53 • 1

SteelQuants/MSM-MS-Cydrion-22B-Q6_K-GGUF

Updated Oct 3 • 54 • 3