Edit Models filters

Inference status

Misc

arxiv: 2409.12186

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

140

Full-text search

Active filters: 2409.12186

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int8

Text Generation • Updated 1 day ago • 1.3k • 2

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated 1 day ago • 20.1k • 7

unsloth/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated 1 day ago • 357 • 2

unsloth/Qwen2.5-Coder-7B-Instruct

Text Generation • Updated 1 day ago • 566 • 4

Handgun1773/Qwen2.5-Coder-7B-BASE-8.0bpw-exl2

Text Generation • Updated Oct 4 • 8 • 1

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated 2 days ago • 307 • 1

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated 2 days ago • 56 • 1

XelotX/Qwen2.5-Coder-32B-Instruct-Quants

Text Generation • Updated 1 day ago • 169 • 1

QuantFactory/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 1 day ago • 379 • 1

QuantFactory/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 1 day ago • 365 • 1

QuantFactory/Qwen2.5-Coder-14B-GGUF

Text Generation • Updated about 21 hours ago • 288 • 1

CISCai/Qwen2.5-Coder-7B-Instruct-SOTA-GGUF

Text Generation • Updated Sep 19 • 250

RichardErkhov/Qwen_-_Qwen2.5-Coder-7B-gguf

Updated Sep 20 • 385

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated 1 day ago • 643

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated 1 day ago • 733 • 1

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • Updated 1 day ago • 5.15k

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • Updated 1 day ago • 741 • 1

Orion-zhen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 194 • 1

unsloth/Qwen2.5-Coder-1.5B-bnb-4bit

Text Generation • Updated 1 day ago • 1.65k • 1

unsloth/Qwen2.5-Coder-1.5B

Text Generation • Updated 1 day ago • 59 • 1

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • Updated 1 day ago • 1.76k • 2

unsloth/Qwen2.5-Coder-7B

Text Generation • Updated 1 day ago • 266 • 1

unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 1.02k

unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 2.68k • 4

pL-Community/Qwen2.5-Coder-7B-Instruct-FP8-Dynamic

Text Generation • Updated Sep 23 • 15

RichardErkhov/Qwen_-_Qwen2.5-Coder-1.5B-Instruct-gguf

Updated Sep 27 • 575

RichardErkhov/Qwen_-_Qwen2.5-Coder-1.5B-gguf

Updated Sep 27 • 408

duyntnet/Qwen2.5-Coder-7B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 27 • 656

Alignment-Lab-AI/Qwen2.5-Coder-7B-Instruct-132k

Text Generation • Updated Oct 2 • 17

mav23/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Oct 3 • 285