Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

17,400

Full-text search

Active filters: 4-bit

prithivMLmods/Llama-3.2-3B-GGUF

Text Generation • Updated 3 days ago • 785 • 8

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated about 3 hours ago • 36.1k • 48

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated 6 days ago • 46.9k • 6

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9 • 59.9k • 42

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated 3 days ago • 7k • 11

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Sep 11 • 616k • 41

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 20.7k • 34

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9 • 31k • 40

imnotednamode/mochi-1-preview-mix-nf4-small

Updated 10 days ago • 110 • 7

ModelCloud/Qwen2.5-Coder-32B-Instruct-gptqmodel-4bit-vortex-v1

Text Generation • Updated 7 days ago • 90 • 7

mlx-community/miscii-14b-1028-4bit

Text Generation • Updated 7 days ago • 31 • 3

KnutJaegersberg/Athene-V2-Chat-72B-4bit

Text Generation • Updated 6 days ago • 69 • 3

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 20.4k • 26

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21 • 14.3k • 16

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated 3 days ago • 21.6k • 9

SeanScripts/pixtral-12b-nf4

Image-Text-to-Text • Updated Sep 26 • 1.64k • 18

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.87M • 8

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-4.0bpw-h6-exl2

Updated Sep 26 • 59 • 2

Ayush12a/llama3.1_finetuned_on_indian_legal_dataset

Text Generation • Updated Oct 21 • 204 • 3

thwin27/Aria-sequential_mlp-bnb_nf4

Image-Text-to-Text • Updated 29 days ago • 621 • 10

arifulFarhad/Rombos-LLM-V2.6-Qwen-14b-gptq-int4

Updated 10 days ago • 12 • 2

ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5

Text Generation • Updated 10 days ago • 80 • 2

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated 3 days ago • 2.96k • 5

mlx-community/Qwen2.5-Coder-32B-Instruct-4bit

Text Generation • Updated 10 days ago • 697 • 5

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated 10 days ago • 375 • 2

FractalGPT/RuQwen2.5-3B-Instruct-AWQ

Text Generation • Updated 7 days ago • 551 • 5

cmarkea/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated 7 days ago • 97 • 2

SandeepKumarRudhravaram/gemma2b_lungcancerqa

Text Generation • Updated 3 days ago • 138 • 2

radm/Athene-V2-Chat-AWQ

Text Generation • Updated 2 days ago • 59 • 2

MikeRoz/mistralai_Mistral-Large-Instruct-2411-4.0bpw-h6-exl2

Updated 2 days ago • 40 • 2