Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,566

Full-text search

Active filters: pruna-ai

PrunaAI/mistralai-Mistral-7B-Instruct-v0.2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/tiiuae-falcon-rw-1b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/tiiuae-falcon-7b-instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/openai-community-gpt2-xl-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 23

PrunaAI/HuggingFaceH4-zephyr-7b-beta-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 34

PrunaAI/openai-community-gpt2-xl-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 9

PrunaAI/teknium-OpenHermes-2-Mistral-7B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/fxmarty-tiny-llama-fast-tokenizer-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 28

PrunaAI/codellama-CodeLlama-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/tiiuae-falcon-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/NousResearch-Llama-2-7b-chat-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 77

PrunaAI/teknium-OpenHermes-2.5-Mistral-7B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/JackFram-llama-68m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/JackFram-llama-68m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/trl-internal-testing-dummy-GPT2-correct-vocab-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 137

PrunaAI/EleutherAI-gpt-neo-2.7B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 27

PrunaAI/trl-internal-testing-dummy-GPT2-correct-vocab-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/tiiuae-falcon-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/echarlaix-tiny-random-mistral-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/EleutherAI-gpt-neo-1.3B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/tiiuae-falcon-rw-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/EleutherAI-gpt-neo-1.3B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/HuggingFaceH4-tiny-random-LlamaForCausalLM-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 180

PrunaAI/bigscience-bloom-7b1-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/EleutherAI-gpt-neo-2.7B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 7

PrunaAI/facebook-opt-iml-1.3b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/microsoft-phi-1_5-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 24

PrunaAI/amazon-MistralLite-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/microsoft-phi-1_5-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/tiiuae-falcon-rw-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12