Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

11,957

Full-text search

Active filters: bitsandbytes

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated 9 days ago • 63.2k • 6

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated 10 days ago • 5.38k • 3

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated 10 days ago • 10.4k • 2

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 2.07k • 3

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 8.35k • 7

unsloth/Qwen2.5-32B-bnb-4bit

Text Generation • Updated Sep 23 • 3.54k • 1

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 16k • 1

unsloth/Qwen2.5-Math-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 327 • 1

unsloth/Llama-3.2-1B-bnb-4bit

Text Generation • Updated Sep 30 • 53.6k • 7

unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 107k • 10

unsloth/Llama-3.2-3B-bnb-4bit

Text Generation • Updated Sep 30 • 51.1k • 6

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 266k • 14

SeanScripts/Llama-3.2-11B-Vision-Instruct-nf4

Image-Text-to-Text • Updated Sep 26 • 5.89k • 4

unsloth/Llama-3.2-90B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated 1 day ago • 3.78k • 13

SeanScripts/Molmo-72B-0924-nf4

Image-Text-to-Text • Updated Oct 2 • 661 • 4

NetoAISolutions/TSLAM-4B

Updated 22 days ago • 213 • 3

sunilrufus/Mistral_Instruct_Nemo_12B_quantized_w8a8

Text Generation • Updated Sep 30 • 319 • 1

ThetaCursed/Ovis1.6-Gemma2-9B-bnb-4bit

Updated Oct 1 • 219 • 5

emre570/llama3.2-1b-tr-qlora

Text Generation • Updated Oct 2 • 63 • 2

zamal/Molmo-7B-GPTQ-4bit

Updated Oct 4 • 423 • 3

thanhkt/codegemma-7B-ManimGen

Text Generation • Updated Oct 14 • 48 • 1

John6666/Llama-3.1-8B-Lexi-Uncensored-V2-nf4

Text Generation • Updated Oct 13 • 1.6k • 6

John6666/llama-joycaption-alpha-two-hf-llava-nf4

Image-Text-to-Text • Updated Oct 16 • 1.33k • 8

shrujan142/loomina_ai

Text Generation • Updated Oct 16 • 42 • 1

unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Text Generation • Updated Oct 17 • 13.7k • 18

Ayush12a/llama3.1_finetuned_on_indian_legal_dataset

Text Generation • Updated Oct 21 • 204 • 3

amornpan/openthaigpt-MedChatModelv11

Text Generation • Updated 18 days ago • 551 • 2

diffusers/t5-nf4

Updated about 1 month ago • 9.9k • 1

ascktgcc/Mistral-Nemo-Japanese-Instruct-2408-bnb-4bit

Text Generation • Updated about 1 month ago • 144 • 1

sayakpaul/sd35-large-nf4

Text-to-Image • Updated 25 days ago • 5