Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

2,837

Full-text search

Active filters: GGUF

kunci115/llama3-finetuned-conversational-Q4-GGUF

Text Generation • Updated Jul 8 • 13

legraphista/NuminaMath-7B-TIR-IMat-GGUF

Text Generation • Updated Jul 11 • 887 • 1

XelotX/WizardLM-2-8x22B-XelotX-iQuants

Text Generation • Updated Jul 12 • 35

MaziyarPanahi/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16 • 1.82M • 6

legraphista/mathstral-7B-v0.1-IMat-GGUF

Text Generation • Updated Jul 16 • 574

MaziyarPanahi/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 105 • 5

KLMFOREVER/WizardLM-2-7B-q4f16_1-MLC

Text Generation • Updated Jul 18

foulds/h2o-danube3-500m-chat-llamafile

Text Generation • Updated Jul 18 • 9

legraphista/Athene-70B-IMat-GGUF

Text Generation • Updated Jul 28 • 604 • 3

MaziyarPanahi/SmolLM-135M-Instruct-GGUF

Text Generation • Updated Jul 22 • 205 • 2

MaziyarPanahi/SmolLM-360M-Instruct-GGUF

Text Generation • Updated Jul 22 • 75 • 1

MaziyarPanahi/SmolLM-1.7B-Instruct-GGUF

Text Generation • Updated Jul 22 • 276 • 4

legraphista/Mistral-Nemo-Instruct-2407-IMat-GGUF

Text Generation • Updated Jul 23 • 1.28k • 2

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23 • 1.82M • 14

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 26 • 117k • 20

LiteLLMs/mathstral-7B-v0.1-GGUF

Updated Jul 25 • 35

LiteLLMs/Mistral-Nemo-Instruct-2407-GGUF

Updated Jul 25 • 171

GPT4All-Community/Yi-1.5-9B-Chat-16K-GGUF

Text Generation • Updated Aug 20 • 1.28k

legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUF

Text Generation • Updated Jul 28 • 925 • 1

MaziyarPanahi/calme-2.1-llama3.1-70b-GGUF

Text Generation • Updated Jul 31 • 128 • 2

GPT4All-Community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Aug 13 • 2.06k • 2

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • Updated Jul 31 • 235 • 1

legraphista/gemma-2-2b-IMat-GGUF

Text Generation • Updated Jul 31 • 1.14k • 1

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1 • 1.83M • 4

MaziyarPanahi/calme-2.2-qwen2-72b-GGUF

Text Generation • Updated Aug 6 • 1.51k • 2

GPT4All-Community/gemma-2-9b-it-GGUF

Text Generation • Updated Aug 20 • 1.16k

legraphista/internlm2_5-1_8b-chat-IMat-GGUF

Text Generation • Updated Aug 5 • 244

legraphista/internlm2_5-20b-chat-IMat-GGUF

Text Generation • Updated Aug 5 • 884

legraphista/shieldgemma-2b-IMat-GGUF

Text Generation • Updated Aug 5 • 450

legraphista/shieldgemma-9b-IMat-GGUF

Text Generation • Updated Aug 5 • 462