Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

162

Full-text search

Active filters: granite

sdalemorrey/granite-8b-code-instruct-128k-Q8_0-GGUF

Text Generation • Updated Aug 5 • 16

TobDeBer/granite-8b-code-instruct-128k-Q4_K_M-GGUF

Text Generation • Updated Aug 8 • 6

maxwellb-hf/granite-8b-code-instruct-128k-Q5_K_M-GGUF

Text Generation • Updated Aug 13 • 5

mradermacher/granite-20b-code-base-GGUF

Updated Aug 31 • 140

legraphista/granite-20b-code-instruct-IMat-GGUF

Text Generation • Updated Sep 1 • 696

mradermacher/granite-3b-code-base-128k-GGUF

Updated Sep 4 • 72

mradermacher/granite-3b-code-base-2k-GGUF

Updated Sep 3 • 211

mradermacher/granite-3b-code-instruct-2k-GGUF

Updated Sep 4 • 7

mradermacher/granite-3b-code-base-2k-i1-GGUF

Updated Sep 3 • 280

mradermacher/granite-8b-code-base-128k-GGUF

Updated Sep 3 • 115

mradermacher/granite-8b-code-base-4k-GGUF

Updated Sep 4 • 9

mradermacher/granite-8b-code-instruct-4k-GGUF

Updated Sep 4 • 168

mradermacher/granite-20b-code-base-8k-GGUF

Updated Sep 4 • 135

mradermacher/granite-20b-code-instruct-8k-GGUF

Updated Sep 3 • 65

mradermacher/granite-20b-code-instruct-8k-i1-GGUF

Updated Sep 6 • 113

mradermacher/granite-34b-code-base-8k-GGUF

Updated Sep 4 • 66

mradermacher/granite-3b-code-base-128k-i1-GGUF

Updated Sep 4 • 215

mradermacher/granite-8b-code-instruct-4k-i1-GGUF

Updated Sep 4 • 241

mradermacher/granite-3b-code-instruct-2k-i1-GGUF

Updated Sep 4 • 172

mradermacher/granite-20b-code-base-8k-i1-GGUF

Updated Sep 4 • 520

mradermacher/granite-8b-code-base-4k-i1-GGUF

Updated Sep 5 • 146

mradermacher/granite-34b-code-base-8k-i1-GGUF

Updated Sep 4 • 304

QuantFactory/granite-7b-instruct-GGUF

Text Generation • Updated Sep 5 • 425 • 2

QuantFactory/granite-3b-code-base-2k-GGUF

Text Generation • Updated Sep 7 • 182 • 2

QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • Updated Sep 7 • 316 • 2

QuantFactory/granite-8b-code-instruct-4k-GGUF

Text Generation • Updated Sep 7 • 143 • 2

Triangle104/granite-8b-code-instruct-4k-Q4_0-GGUF

Text Generation • Updated Sep 7 • 17

Triangle104/granite-8b-code-instruct-4k-Q4_K_S-GGUF

Text Generation • Updated Sep 7 • 6

Triangle104/granite-8b-code-instruct-4k-Q4_K_M-GGUF

Text Generation • Updated Sep 7 • 3

Triangle104/granite-8b-code-instruct-4k-Q5_0-GGUF

Text Generation • Updated Sep 7 • 215