Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,785

Full-text search

Active filters: pruna-ai

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 2 • 1

PrunaAI/ybelkada-falcon-7b-sharded-bf16-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/NousResearch-Yarn-Mistral-7b-64k-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/OpenBuddy-openbuddy-openllama-7b-v12-bf16-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13 • 1

PrunaAI/ybelkada-falcon-7b-sharded-bf16-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/dbmdz-german-gpt2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/ytu-ce-cosmos-turkish-gpt2-large-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/Open-Orca-Mistral-7B-SlimOrca-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 8

PrunaAI/Cheng98-llama-160m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/AI-Sweden-Models-gpt-sw3-126m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/AI-Sweden-Models-gpt-sw3-126m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/Cheng98-llama-160m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/dbmdz-german-gpt2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 9

PrunaAI/OpenBuddy-openbuddy-openllama-7b-v12-bf16-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/princeton-nlp-Sheared-LLaMA-2.7B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/robowaifudev-megatron-gpt2-345m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/meta-math-MetaMath-Mistral-7B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/robowaifudev-megatron-gpt2-345m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/NousResearch-Yarn-Mistral-7b-64k-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/facebook-xglm-7.5B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/bigscience-bloomz-7b1-mt-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/princeton-nlp-Sheared-LLaMA-2.7B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/facebook-xglm-7.5B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/uukuguy-speechless-code-mistral-7b-v1.0-bnb-4bit-smashed

Updated Aug 2 • 3

PrunaAI/beomi-open-llama-2-ko-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/FlagAlpha-Llama2-Chinese-7b-Chat-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/KnutJaegersberg-Qwen-1_8B-Llamafied-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/meta-math-MetaMath-Mistral-7B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/lvwerra-gpt2-imdb-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/lvwerra-gpt2-imdb-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10