Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

847

Full-text search

Active filters: imatrix

lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 8.7k • 25

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23 • 2.99k • 42

lmstudio-community/aya-23-8B-GGUF

Text Generation • Updated May 23 • 2k • 6

cognitivecomputations/dolphin-2.9.2-qwen2-72b-gguf

Updated May 29 • 2.73k • 17

mradermacher/quill-72b-instruct-i1-GGUF

Updated Aug 2 • 451 • 4

mradermacher/L3-8B-Stheno-v3.2-i1-GGUF

Updated Aug 2 • 1.8k • 10

bartowski/Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation • Updated Jun 5 • 661 • 10

mradermacher/JailbrokeAI-i1-GGUF

Updated Aug 2 • 454 • 1

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Aug 21 • 14.9k • 60

Qwen/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 21 • 8.24k • 167

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.12M • 9

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 7 • 320 • 13

bartowski/dolphin-2.9.2-qwen2-72b-GGUF

Text Generation • Updated Jun 11 • 506 • 3

duyntnet/pygmalion-2-7b-imatrix-GGUF

Text Generation • Updated Jun 13 • 148 • 1

mradermacher/L3-70B-Euryale-v2.1-i1-GGUF

Updated Aug 2 • 2.19k • 21

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • Updated Jun 17 • 1.38k • 4

dreamgen/opus-v1.4-70b-llama3-gguf

Text Generation • Updated Jun 19 • 4.4k • 4

mradermacher/DeepSeek-Coder-V2-Instruct-i1-GGUF

Updated Aug 2 • 91 • 6

mradermacher/Tenebra_30B_Alpha01_FP16-i1-GGUF

Updated Aug 2 • 424 • 1

lmstudio-community/Qwen2-500M-Instruct-GGUF

Text Generation • Updated Jun 24 • 187 • 6

bartowski/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Text Generation • Updated Jun 24 • 1.2k • 23

bartowski/Replete-Coder-Llama3-8B-GGUF

Text Generation • Updated Jun 24 • 782 • 15

mradermacher/L-MChat-7b-i1-GGUF

Updated Aug 2 • 161 • 1

grapevine-AI/gemma-2-27b-it-gguf

Updated 29 days ago • 1.45k • 12

duyntnet/Silicon-Maid-7B-imatrix-GGUF

Text Generation • Updated Jul 2 • 3.34k • 4

bartowski/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Aug 3 • 13.1k • 29

dahara1/gemma-2-27b-it-gguf-japanese-imatrix

Updated Sep 24 • 462 • 13

mradermacher/Gemma-2-9B-It-SPPO-Iter3-i1-GGUF

Updated Oct 20 • 1.08k • 3

mradermacher/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-i1-GGUF

Updated Aug 2 • 844 • 2

mradermacher/L3-8B-Stheno-v3.2-abliterated-i1-GGUF

Updated Aug 2 • 607 • 3