Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

8,197

Full-text search

Active filters: qwen2

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 19 • 3.32k • 2

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 1.76k • 5

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18 • 51.1k • 9

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 5.4k • 9

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 4.29k • 11

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 10.1k • 19

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 15.9k • 8

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 21.6k • 23

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 7.21k • 7

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.75k • 4

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 1.69k • 3

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9 • 3.36k • 4

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 18.1k • 8

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9 • 41.8k • 9

stvlynn/Reflection-Chinese-32B

Updated Sep 18 • 6 • 3

Qwen/Qwen2.5-Coder-1.5B

Text Generation • Updated 3 days ago • 17.7k • 32

Qwen/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated 3 days ago • 18.7k • 43

mlx-community/Qwen2.5-0.5B-Instruct-4bit

Text Generation • Updated Sep 18 • 520 • 1

mlx-community/Qwen2.5-14B-Instruct-4bit

Text Generation • Updated Sep 18 • 2.78k • 2

mlx-community/Qwen2.5-7B-Instruct-4bit

Text Generation • Updated 15 days ago • 530 • 3

unsloth/Qwen2.5-0.5B

Text Generation • Updated 9 days ago • 2.41k • 3

unsloth/Qwen2.5-3B

Text Generation • Updated 10 days ago • 3.86k • 1

unsloth/Qwen2.5-7B

Text Generation • Updated 10 days ago • 3.52k • 2

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated 10 days ago • 63.2k • 6

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated 10 days ago • 5.38k • 3

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated 10 days ago • 10.4k • 2

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 2.07k • 3

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 8.35k • 7

second-state/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20 • 218 • 2

mlx-community/Qwen2.5-72B-Instruct-8bit

Text Generation • Updated Sep 19 • 108 • 3