Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

12,064

Full-text search

Active filters: bitsandbytes

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 3.03k • 26

saheedniyi/Llama3-8b-Naija_v1

Text Generation • Updated Jun 4 • 53 • 8

shaheerzk/text_to_sql

Text Generation • Updated 30 days ago • 147 • 1

rubenamtz0/llama-3-8b-lora-law2entity

Updated Jun 4 • 85 • 1

jihadzakki/idefics2-8b-vqarad-delta

Visual Question Answering • Updated Jun 13 • 34 • 3

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 105 • 7

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 1.61k • 23

unclecode/folrence-2-large-4bit

Text Generation • Updated Jun 26 • 666 • 3

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3 • 926 • 21

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3 • 525 • 8

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated 2 days ago • 29.6k • 20

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3 • 6.27k • 8

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Sep 11 • 6.42k • 11

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 20.3k • 24

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 657k • 41

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 2 days ago • 8.38k • 28

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 20.2k • 26

SoumilB7/L3_8B_Solana_Smart_Contract_Analyser

Text Generation • Updated Aug 22 • 17 • 1

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 75.5k • 67

tiiuae/falcon-mamba-7b-instruct-4bit

Updated Oct 10 • 107 • 12

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 22 • 1

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22 • 115 • 3

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 904 • 35

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 133 • 7

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1 • 150 • 12

unsloth/Reflection-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 8 • 202 • 15

bagwai/fine-tuned-gemma-7b-Hausa

Text Classification • Updated Sep 8 • 1 • 2

axolotl-quants/DeepSeek-V2.5-bnb-nf4-bf16

Updated Sep 12 • 101 • 1

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14 • 7 • 6

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 67.1k • 6