Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

6,670

Full-text search

Active filters: llama-cpp

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 6 days ago • 7.59k • 26

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated 6 days ago • 3.24k • 11

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 1.35k • 9

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 7.41k • 7

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26 • 2.75k • 31

byroneverson/gemma-2-27b-it-abliterated-gguf

Text Generation • Updated 22 days ago • 2.57k • 12

NikolayKozloff/NightyGurps-14b-v1.1-Q5_K_M-GGUF

Updated 9 days ago • 2 • 2

VlSav/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q4_K_M-GGUF

Updated 9 days ago • 217 • 5

VlSav/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q8_0-GGUF

Updated 9 days ago • 176 • 2

werty1248/Mistral-Nemo-NT-Ko-12B-dpo-GGUF

Updated 6 days ago • 112 • 2

NikolayKozloff/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated 5 days ago • 68 • 2

mylesgoose/Llama-3.2-3B-instruct-abliterated-Q8_0-GGUF

Updated 4 days ago • 315 • 2

darkc0de/Llama-3.2-3B-Instruct-abliterated-Q8_0-GGUF

Updated 3 days ago • 223 • 2

pcuenq/Qwen2.5-0.5B-Instruct-with-new-merges-serialization-Q8_0-GGUF

Text Generation • Updated about 24 hours ago • 7 • 2

Thanabordee/openthaigpt1.5-7b-instruct-Q4_K_M-GGUF

Text Generation • Updated about 21 hours ago • 29 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 286 • 7

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 1.8k • 46

tspersian/mT5_base_translation_English_to_Persian-Farsi-Q4_K_M-GGUF

Translation • Updated Jul 14 • 40 • 1

Ayylex/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 23 • 7 • 1

polyverse/falcon-7b-Q4_K_M-GGUF

Updated Aug 1 • 156 • 1

jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF

Text Generation • Updated Aug 4 • 65 • 5

polyverse/falcon-7b-Q5_K_M-GGUF

Updated Aug 7 • 39 • 1

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated 29 days ago • 991 • 4

HuggingFaceTB/smollm-135M-instruct-v0.2-Q8_0-GGUF

Updated Aug 18 • 1.32k • 4

winvoker/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Aug 14 • 2 • 1

byroneverson/glm-4-9b-chat-abliterated-gguf

Text Generation • Updated 29 days ago • 2.13k • 6

goodasdgood/Llama-3.1-8B-Lexi-Uncensored-V2-Q8_0-GGUF

Updated Aug 25 • 75 • 1

genevera/glm-4-9b-chat-abliterated-Q6_K-GGUF

Text Generation • Updated Aug 26 • 23 • 1

byroneverson/Yi-1.5-9B-Chat-16K-abliterated-gguf

Text Generation • Updated 28 days ago • 59 • 1

byroneverson/internlm2_5-20b-chat-abliterated-gguf

Text Generation • Updated 28 days ago • 161 • 1