Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

Misc with no match

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

87

Full-text search

Active filters: granite-3.0

davelsphere/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 12

davelsphere/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 9

davelsphere/granite-3.0-8b-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 19

davelsphere/granite-3.0-2b-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 18

davelsphere/granite-3.0-3b-a800m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 12

davelsphere/granite-3.0-1b-a400m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 11

davelsphere/granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 9

lmstudio-community/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Oct 21 • 221

lmstudio-community/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 292

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 9

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 16

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 7

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 6

Triangle104/granite-3.0-1b-a400m-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 5

Triangle104/granite-3.0-1b-a400m-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 11

Triangle104/granite-3.0-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 10

Triangle104/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 5

Triangle104/granite-3.0-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 13

Triangle104/granite-3.0-2b-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 15

Triangle104/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated 30 days ago • 41

Triangle104/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 12

MCZK/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 84

aashish1904/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 9

MCZK/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 204

1FriendlyDoge/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 14

farpluto/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 22 • 9

royleibov/granite-3.0-8b-instruct-ZipNN-Compressed

Text Generation • Updated Oct 22 • 25

osllmai/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated about 1 month ago • 130