Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,576

Full-text search

Active filters: pruna-ai

PrunaAI/h2oai-h2o-danube2-1.8b-chat-HQQ-1bit-smashed

Text Generation • Updated Jul 15 • 6

PrunaAI/h2oai-h2o-danube2-1.8b-chat-HQQ-2bit-smashed

Text Generation • Updated Jul 15 • 8

PrunaAI/h2oai-h2o-danube2-1.8b-chat-QUANTO-int2bit-smashed

Updated Jul 19 • 4

PrunaAI/h2oai-h2o-danube2-1.8b-chat-HQQ-4bit-smashed

Text Generation • Updated Jul 15 • 8

PrunaAI/qnguyen3-Master-Yi-9B-QUANTO-int8bit-smashed

Updated Jul 19 • 3

PrunaAI/qnguyen3-Master-Yi-9B-QUANTO-float8bit-smashed

Updated Jul 19 • 1

PrunaAI/qnguyen3-Master-Yi-9B-QUANTO-int4bit-smashed

Updated Jul 19 • 2

PrunaAI/qnguyen3-Master-Yi-9B-QUANTO-int2bit-smashed

Updated Jul 19 • 1

PrunaAI/qnguyen3-Master-Yi-9B-bnb-4bit-smashed

Text Generation • Updated Jul 15 • 8

PrunaAI/qnguyen3-Master-Yi-9B-HQQ-1bit-smashed

Text Generation • Updated Jul 15 • 7

PrunaAI/qnguyen3-Master-Yi-9B-bnb-8bit-smashed

Text Generation • Updated Jul 15 • 8

PrunaAI/qnguyen3-Master-Yi-9B-HQQ-2bit-smashed

Text Generation • Updated Jul 15 • 4

PrunaAI/qnguyen3-Master-Yi-9B-HQQ-4bit-smashed

Text Generation • Updated Jul 15 • 6

PrunaAI/h2oai-h2o-danube2-1.8b-chat-QUANTO-int4bit-smashed

Updated Jul 19 • 1

PrunaAI/h2oai-h2o-danube2-1.8b-chat-QUANTO-int8bit-smashed

Updated Jul 19 • 3

PrunaAI/h2oai-h2o-danube2-1.8b-chat-QUANTO-float8bit-smashed

Updated Jul 19 • 1

PrunaAI/qnguyen3-Master-Yi-9B-AWQ-4bit-smashed

Text Generation • Updated Jul 15 • 8

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-bnb-4bit-smashed

Text Generation • Updated Jul 15 • 8

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-QUANTO-int8bit-smashed

Updated Jul 19 • 1

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-QUANTO-int2bit-smashed

Updated Jul 19 • 1

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-bnb-8bit-smashed

Text Generation • Updated Jul 15 • 11

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-HQQ-2bit-smashed

Text Generation • Updated Jul 15 • 4

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-HQQ-1bit-smashed

Text Generation • Updated Jul 15 • 8

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-HQQ-4bit-smashed

Text Generation • Updated Jul 15 • 9

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 8

PrunaAI/google-gemma-1.1-2b-it-HQQ-4bit-smashed

Text Generation • Updated Jul 16 • 7

PrunaAI/google-gemma-1.1-2b-it-QUANTO-int4bit-smashed

Updated Jul 19 • 4

PrunaAI/google-gemma-1.1-2b-it-QUANTO-int2bit-smashed

Updated Jul 19 • 1

PrunaAI/google-gemma-1.1-2b-it-QUANTO-float8bit-smashed

Updated Jul 19 • 1

PrunaAI/google-gemma-1.1-2b-it-QUANTO-int8bit-smashed

Updated Jul 19 • 1