Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,401

Full-text search

Active filters: instruct

koesn/Llama3.1-8B-Enigma-GGUF

Text Generation • Updated Sep 11 • 67

monsterapi/gemma-2-2b-norobots

Updated Sep 13 • 54

koesn/Llama3.1-8B-Fireplace2-GGUF

Text Generation • Updated Sep 12 • 36

Triangle104/Hermes-2-Pro-Llama-3-8B-Q4_0-GGUF

Updated Sep 15 • 46

meaningalignment/wise-llama

Updated Oct 11 • 10

bartowski/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • Updated Sep 17 • 603 • 2

stephenlzc/Llama-3-8B-Lexi-Uncensored-Q2_K-GGUF

Updated Sep 19 • 26

QuantFactory/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • Updated Sep 20 • 156 • 1

v000000/Qwen2.5-Lumen-14B-Q6_K-GGUF

Text Generation • Updated Sep 20 • 35 • 1

Lambent/Qwen2.5-Lumen-14B-Q4_K_M-GGUF

Text Generation • Updated Sep 20 • 28 • 1

dasChronos1/Qwen2.5-Lumen-14B-Q8_0-GGUF

Text Generation • Updated Sep 20 • 11

Triangle104/Hermes-3-Llama-3.1-8B-Q4_K_S-GGUF

Updated Sep 21 • 5

Triangle104/Hermes-3-Llama-3.1-8B-Q5_K_S-GGUF

Triangle104/Hermes-3-Llama-3.1-8B-Q5_K_M-GGUF

Updated Sep 21 • 2

Triangle104/Qwen2.5-Lumen-14B-Q4_0-GGUF

Text Generation • Updated Sep 21 • 23

Triangle104/Qwen2.5-Lumen-14B-Q4_K_S-GGUF

Text Generation • Updated Sep 21 • 6

Triangle104/Qwen2.5-Lumen-14B-Q4_K_M-GGUF

Text Generation • Updated Sep 21 • 29

Triangle104/Qwen2.5-Lumen-14B-Q5_0-GGUF

Text Generation • Updated Sep 21 • 11

Triangle104/Qwen2.5-Lumen-14B-Q5_K_S-GGUF

Text Generation • Updated Sep 21 • 7

Triangle104/Qwen2.5-Lumen-14B-Q5_K_M-GGUF

Text Generation • Updated Sep 21 • 18

Triangle104/Qwen2.5-Lumen-14B-Q6_K-GGUF

Text Generation • Updated Sep 21 • 11

Triangle104/Qwen2.5-Lumen-14B-Q8_0-GGUF

Text Generation • Updated Sep 21 • 51

teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-context-gguf

Text Generation • Updated Sep 22 • 312

QuantFactory/Llama3-OpenBioLLM-8B-GGUF

Updated Sep 22 • 95 • 1

byroneverson/Mistral-Small-Instruct-2409-abliterated-gguf

Text Generation • Updated Sep 23 • 44 • 3

WSDW/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Sep 23 • 8

jxtngx/Hermes-3-Llama-3.1-8B-Q4_0-GGUF

Updated Sep 23 • 56

mradermacher/Mistral-Small-Instruct-2409-abliterated-i1-GGUF

Updated Sep 24 • 1.62k • 1

QuantFactory/Mistral-Trismegistus-7B-GGUF

Updated Sep 26 • 107 • 1

ValiantLabs/Llama3.2-3B-ShiningValiant2

Text Generation • Updated 13 days ago • 379 • 1