Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

9,410

Full-text search

Active filters: gguf-my-repo

Triangle104/Llama-3.1-8B-ArliAI-RPMax-v1.3-Q8_0-GGUF

Updated 6 days ago • 51 • 1

win10/ArliAI-RPMax-v1.3-merge-8B-Q8_0-GGUF

Updated 12 days ago • 24 • 1

win10/Norns-Qwen2.5-12B-Q8_0-GGUF

Updated 12 days ago • 50 • 1

win10/EVA-Norns-Qwen2.5-v0.1-Q8_0-GGUF

Updated 12 days ago • 90 • 1

Triangle104/AstroSage-8B-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 25 • 1

win10/miscii-14b-1028-Q8_0-GGUF

Text Generation • Updated 10 days ago • 49 • 1

Triangle104/MN-12B-Starcannon-v2-Q4_K_S-GGUF

Updated 10 days ago • 27 • 1

Triangle104/MN-12B-Starcannon-v2-Q4_K_M-GGUF

Updated 10 days ago • 28 • 1

Triangle104/MN-12B-Starcannon-v2-Q5_K_S-GGUF

Updated 10 days ago • 26 • 1

Triangle104/MN-12B-Starcannon-v2-Q5_K_M-GGUF

Updated 10 days ago • 26 • 1

Triangle104/MN-12B-Starcannon-v2-Q6_K-GGUF

Updated 10 days ago • 28 • 1

Triangle104/MN-12B-Starcannon-v2-Q8_0-GGUF

Updated 10 days ago • 30 • 1

Triangle104/MN-Chunky-Lotus-12B-Q4_K_S-GGUF

Updated 8 days ago • 22 • 1

Triangle104/MN-Chunky-Lotus-12B-Q4_K_M-GGUF

Updated 8 days ago • 25 • 1

Triangle104/MN-Chunky-Lotus-12B-Q5_K_S-GGUF

Updated 8 days ago • 24 • 1

Triangle104/MN-Chunky-Lotus-12B-Q5_K_M-GGUF

Updated 8 days ago • 22 • 1

Triangle104/MN-Chunky-Lotus-12B-Q6_K-GGUF

Updated 8 days ago • 26 • 1

Triangle104/MN-Chunky-Lotus-12B-Q8_0-GGUF

Updated 8 days ago • 32 • 1

HumanBoiii/B-NIMITA-L3-8B-v0.02-Q4_K_M-GGUF

Updated 8 days ago • 30 • 1

zelk12/MT3-Gen2-gemma-2-9B-Q6_K-GGUF

Text Generation • Updated 6 days ago • 26 • 1

fuzzy-mittenz/Sakura_Warding-Qw2.5-7B-Q4_K_M-GGUF

Updated 3 days ago • 200 • 2

ZeroXClem/L3-Aspire-Heart-Matrix-8B-Q5_0-GGUF

Text Generation • Updated 8 days ago • 25 • 1

ZeroXClem/L3-Aspire-Heart-Matrix-8B-Q4_K_M-GGUF

Text Generation • Updated 8 days ago • 28 • 1

win10/high-speed-mixing-7B-V2-Q8_0-GGUF

Updated 8 days ago • 43 • 1

SzilviaB/DarkUnholyDareDevil-8b-abliterated-Q8_0-GGUF

Updated 7 days ago • 53 • 1

KnutJaegersberg/Llama-3.1-Tulu-3-8B-Q8_0-GGUF

Text Generation • Updated 7 days ago • 41 • 1

NikolayKozloff/Llama-3.1-Tulu-3-8B-Q8_0-GGUF

Text Generation • Updated 7 days ago • 22 • 1

NikolayKozloff/BgGPT-Gemma-2-9B-IT-v1.0-Q8_0-GGUF

Text Generation • Updated 7 days ago • 30 • 1

NikolayKozloff/BgGPT-Gemma-2-2.6B-IT-v1.0-Q8_0-GGUF

Text Generation • Updated 7 days ago • 23 • 1

NikolayKozloff/BgGPT-Gemma-2-27B-IT-v1.0-Q2_K-GGUF

Text Generation • Updated 7 days ago • 35 • 1