Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

97

Full-text search

Active filters: qwen2.5

Triangle104/Qwen2.5-Lumen-14B-Q6_K-GGUF

Text Generation • Updated Sep 21 • 9

Triangle104/Qwen2.5-Lumen-14B-Q8_0-GGUF

Text Generation • Updated Sep 21 • 55

QuantFactory/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno-GGUF

Updated Sep 21 • 217 • 2

QuantFactory/Qwen2.5-14B-Gutenberg-1e-Delta-GGUF

Updated Sep 22 • 160 • 2

teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-gguf

Text Generation • Updated Sep 22 • 391 • 7

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q4_0-GGUF

Updated Sep 22 • 19 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q4_K_S-GGUF

Updated Sep 22 • 6 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q4_K_M-GGUF

Updated Sep 22 • 23 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q5_0-GGUF

Updated Sep 22 • 4 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q5_K_S-GGUF

Updated Sep 22 • 4 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q5_K_M-GGUF

Updated Sep 22 • 6 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q6_K-GGUF

Updated Sep 22 • 3 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q8_0-GGUF

Updated Sep 22 • 4 • 1

OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.1-200k

Text Generation • Updated Sep 23 • 2.91k

OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.2-200k

Text Generation • Updated Sep 27 • 24

Cran-May/B-and-W_Flycatcher-Q4_K_M-GGUF

Text Generation • Updated Sep 28 • 6

NLPark/B-and-W_Flycatcher-3AD1E

Text Generation • Updated Oct 2 • 22

mradermacher/B-and-W_Flycatcher-3AD1E-GGUF

Updated Sep 28 • 58

mradermacher/B-and-W_Flycatcher-3AD1E-i1-GGUF

Updated Sep 28 • 107

mradermacher/calme-2.2-qwen2.5-72b-GGUF

Updated Sep 30 • 126 • 1

mradermacher/calme-2.2-qwen2.5-72b-i1-GGUF

Updated Sep 30 • 161 • 1

ZeusLabs/Chronos-Platinum-72B

Text Generation • Updated Oct 12 • 261 • 10

mradermacher/Chronos-Platinum-72B-GGUF

Updated Oct 2 • 127 • 1

bartowski/Chronos-Platinum-72B-GGUF

Text Generation • Updated Oct 1 • 352 • 4

bartowski/Chronos-Platinum-72B-exl2

Text Generation • Updated Oct 3 • 31

OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k

Text Generation • Updated Oct 23 • 2.92k

OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k-Q4_K_M-GGUF

Text Generation • Updated Oct 7 • 13

OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.3-200k-Q4_K_M-GGUF

Text Generation • Updated Oct 11 • 30

risangpanggalih/Bokap-Betawi-v0-Qwen2.5-7B-fp16

Text Generation • Updated Oct 15 • 25

risangpanggalih/Bokap-Betawi-v0-Qwen2.5-7B-4bit

Text Generation • Updated Oct 15 • 23