Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

4,461

Full-text search

Active filters: code

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F32-GGUF

Text Generation • Updated 18 days ago • 17 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • Updated 18 days ago • 13 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F32-GGUF

Text Generation • Updated 18 days ago • 29 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F16-GGUF

Text Generation • Updated 18 days ago • 30 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • Updated 18 days ago • 13 • 1

lmstudio-community/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 12 days ago • 3.05k • 3

lmstudio-community/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated 12 days ago • 1.05k • 1

lmstudio-community/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 12 days ago • 319 • 1

lmstudio-community/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 12 days ago • 343 • 3

bartowski/Qwen2.5.1-Coder-1.5B-Instruct-GGUF

Text Generation • Updated 16 days ago • 3.73k • 1

mlx-community/Qwen2.5.1-Coder-7B-Instruct-4bit

Text Generation • Updated 15 days ago • 102 • 2

mlx-community/Qwen2.5.1-Coder-7B-Instruct-8bit

Text Generation • Updated 15 days ago • 153 • 2

tensorblock/bloom-1b1-GGUF

Text Generation • Updated 8 days ago • 486 • 1

BSC-LT/salamandra-2b-instruct-aina-hack

Text Generation • Updated 15 days ago • 55 • 1

theo77186/Qwen2.5-Coder-7B-Instruct-20241106

Text Generation • Updated 12 days ago • 34 • 3

QuantFactory/Typst-Coder-9B-GGUF

Text Generation • Updated 14 days ago • 343 • 3

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated 5 days ago • 3.66k • 5

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated 5 days ago • 1.9k • 2

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated 5 days ago • 381 • 2

Qwen/Qwen2.5-Coder-0.5B-Instruct-AWQ

Text Generation • Updated 5 days ago • 203 • 1

Qwen/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 12 days ago • 1.72k • 1

QuantFactory/Phi-3-mini-128k-instruct-abliterated-v3-GGUF

Text Generation • Updated 13 days ago • 535 • 3

bartowski/Qwen2.5-Coder-0.5B-GGUF

Text Generation • Updated 12 days ago • 1.3k • 1

bartowski/Qwen2.5-Coder-3B-GGUF

Text Generation • Updated 12 days ago • 1.36k • 1

bartowski/Qwen2.5-Coder-14B-GGUF

Text Generation • Updated 12 days ago • 3.38k • 2

bartowski/Qwen2.5-Coder-32B-GGUF

Text Generation • Updated 12 days ago • 4.92k • 7

lmstudio-community/Qwen2.5-Coder-32B-GGUF

Text Generation • Updated 12 days ago • 1.03k • 2

mlx-community/Qwen2.5-Coder-32B-Instruct-4bit

Text Generation • Updated 12 days ago • 854 • 5

mlx-community/Qwen2.5-Coder-32B-4bit

Text Generation • Updated 12 days ago • 132 • 2

mlx-community/Qwen2.5-Coder-32B-8bit

Text Generation • Updated 12 days ago • 104 • 1