Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

10,983

Full-text search

Active filters: 4-bit

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 21 days ago • 65.4k • 20

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 2.74k • 209

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated May 25 • 460k • 137

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 462k • 100

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 974 • 10

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 583k • 46

allganize/Llama-3-Alpha-Ko-8B-Instruct-GPTQ

Text Generation • Updated 11 days ago • 379 • 3

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated 11 days ago • 47.3k • 14

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated 3 days ago • 271 • 3

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated 3 days ago • 211 • 3

rainjay/gemma-2-27b-it-4bit

Text Generation • Updated 2 days ago • 21 • 3

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 183 • 91

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 2.03k • 11

TechxGenus/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.02k • 9

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated May 22 • 24.5k • 13

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated 25 days ago • 108k • 15

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated 13 days ago • 4.49k • 15

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated 21 days ago • 1.11k • 7

LoneStriker/Higgs-Llama-3-70B-4.0bpw-h6-exl2

Text Generation • Updated 24 days ago • 8 • 2

AlyBendo/DPO-DoubleQuant-MCQA-TrueMixin

Text2Text Generation • Updated 19 days ago • 11 • 2

IlyaGusev/saiga_aya_23_35b_sft_m1_d5_awq_4bit

Text Generation • Updated 8 days ago • 13 • 2

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 1.72k • 186

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.91k • 309

TheBloke/Manticore-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 17 • 37

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 431 • 548

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 112 • 82

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 115 • 176

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 82 • 17

TheBloke/airoboros-13B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 22 • 34

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 83 • 130