Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,574

Full-text search

Active filters: pruna-ai

PrunaAI/BAAI-Bunny-Llama-3-8B-V-HQQ-2bit-smashed

Text Generation • Updated Jul 16 • 8

PrunaAI/BAAI-Bunny-Llama-3-8B-V-HQQ-4bit-smashed

Text Generation • Updated Jul 16 • 9

PrunaAI/BAAI-Bunny-Llama-3-8B-V-QUANTO-int2bit-smashed

Updated Jul 19 • 1

PrunaAI/BAAI-Bunny-Llama-3-8B-V-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 10

PrunaAI/BAAI-Bunny-Llama-3-8B-V-QUANTO-float8bit-smashed

Updated Jul 19 • 3

PrunaAI/w4r10ck-SOLAR-10.7B-Instruct-v1.0-uncensored-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 13

PrunaAI/w4r10ck-SOLAR-10.7B-Instruct-v1.0-uncensored-bnb-8bit-smashed

Text Generation • Updated Jul 16 • 14

PrunaAI/w4r10ck-SOLAR-10.7B-Instruct-v1.0-uncensored-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 13 • 1

PrunaAI/w4r10ck-SOLAR-10.7B-Instruct-v1.0-uncensored-HQQ-2bit-smashed

Text Generation • Updated Jul 16 • 11

PrunaAI/w4r10ck-SOLAR-10.7B-Instruct-v1.0-uncensored-HQQ-4bit-smashed

Text Generation • Updated Jul 16 • 9

PrunaAI/DiscoResearch-Llama3-German-8B-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 14

PrunaAI/DiscoResearch-Llama3-German-8B-bnb-8bit-smashed

Text Generation • Updated Jul 16 • 13

PrunaAI/DiscoResearch-Llama3-German-8B-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 10

PrunaAI/DiscoResearch-Llama3-German-8B-HQQ-2bit-smashed

Text Generation • Updated Jul 16 • 9

PrunaAI/DiscoResearch-Llama3-German-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 8

PrunaAI/TheDrummer-Moistral-11B-v4-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 5

PrunaAI/TheDrummer-Moistral-11B-v4-bnb-8bit-smashed

Text Generation • Updated Jul 16 • 6

PrunaAI/TheDrummer-Moistral-11B-v4-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 6

PrunaAI/TheDrummer-Moistral-11B-v4-HQQ-2bit-smashed

Text Generation • Updated Jul 16 • 6

PrunaAI/TheDrummer-Moistral-11B-v4-QUANTO-int8bit-smashed

Updated Jul 19 • 1

PrunaAI/TheDrummer-Moistral-11B-v4-QUANTO-float8bit-smashed

PrunaAI/TheDrummer-Moistral-11B-v4-QUANTO-int4bit-smashed

PrunaAI/icefog72-IceLatteRP-7b-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 10

PrunaAI/TheDrummer-Moistral-11B-v4-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 65

PrunaAI/icefog72-IceLatteRP-7b-bnb-8bit-smashed

Text Generation • Updated Jul 16 • 11

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-int8bit-smashed

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-float8bit-smashed

Updated Jul 19 • 3

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-int4bit-smashed

Updated Jul 19 • 1

PrunaAI/icefog72-IceLatteRP-7b-QUANTO-int2bit-smashed

Updated Jul 19 • 2

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 8