Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,621

Full-text search

Active filters: awq

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2 • 87 • 3

solidrust/gemma-2-9b-it-AWQ

Text Generation • Updated Sep 3 • 2.1k • 2

solidrust/Hermes-3-Llama-3.1-8B-AWQ

Text Generation • Updated Sep 3 • 436 • 3

solidrust/Llama-3.1-8B-Lexi-Uncensored-V2-AWQ

Text Generation • Updated Sep 3 • 266 • 1

stelterlab/Yi-Coder-9B-Chat-AWQ

Text Generation • Updated Sep 8 • 24 • 3

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated Oct 9 • 2.59k • 6

jfiekdjdk/glm-4-9b-chat-awq

Updated Sep 15 • 14 • 1

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.46k • 4

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 1.55k • 3

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.84k • 4

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 15k • 7

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9 • 40.7k • 9

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9 • 34.7k • 39

solidrust/LLama-3.1-8B-Matrix-AWQ

Text Generation • Updated Sep 19 • 15 • 1

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated 6 days ago • 21.5k • 7

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 113 • 1

hugging-quants/gemma-2-9b-it-AWQ-INT4

Text Generation • Updated Oct 17 • 2.08k • 4

peakji/steiner-32b-preview-awq

Updated 27 days ago • 59 • 3

Guilherme34/CODER-0.5b_awq

Text Generation • Updated 28 days ago • 14 • 1

IntervitensInc/LLAMA-3_8B_Unaligned_BETA-AWQ

Updated 27 days ago • 6 • 1

VAGOsolutions/SauerkrautLM-gemma-2-9b-it-awq

Updated 26 days ago • 2.94k • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated 18 days ago • 1.36k • 1

AMead10/SuperNova-Medius-AWQ

Text Generation • Updated 21 days ago • 1k • 2

joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Text Generation • Updated 12 days ago • 2.26k • 2

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated 6 days ago • 986 • 1

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated 6 days ago • 236 • 1

Orion-zhen/OpenCoder-8B-Instruct-AWQ

Text Generation • Updated 6 days ago • 80 • 1

Alannikos768/BanterBot-7b-chat-w4a16-4bit

Updated 4 days ago • 4 • 1

Alannikos768/BanterBot_1_8b-chat-w4a16-4bit

Updated 4 days ago • 4 • 1

Alannikos768/BoostBot_1_8b-chat-w4a16-4bit

Updated 4 days ago • 6 • 1