Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
4-bit precision
AutoTrain Compatible
text-generation-inference
Inference Endpoints
custom_code
Merge
8-bit precision
Eval Results
Mixture of Experts
text-embeddings-inference
Carbon Emissions
Apply filters
Models
15,055
Full-text search
Edit filters
Sort: Trending
Active filters:
4-bit
Clear all
unsloth/codellama-34b-bnb-4bit
Text Generation
•
Updated
28 days ago
•
543
•
3
TheBloke/dolphin-2.6-mistral-7B-AWQ
Text Generation
•
Updated
Dec 28, 2023
•
202
•
8
TheBloke/openchat-3.5-0106-GPTQ
Text Generation
•
Updated
Jan 10
•
151
•
7
TheBloke/phi-2-electrical-engineering-GPTQ
Text Generation
•
Updated
Jan 13
•
16
•
7
pandasai/bamboo-llm
Text Generation
•
Updated
Jan 17
•
193
•
12
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
Updated
20 days ago
•
11.1k
•
31
TheBloke/CodeLlama-70B-Python-AWQ
Text Generation
•
Updated
Jan 31
•
62
•
6
roshanrai1304/llama_2_finetune_on_real_estate_data
Text Generation
•
Updated
Feb 1
•
43
•
1
MaziyarPanahi/dolphin-2.5-mixtral-8x7b-GGUF
Text Generation
•
Updated
Feb 4
•
346
•
4
Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4
Text Generation
•
Updated
Apr 30
•
89
•
12
Tann-dev/sex-chat-dirty-girlfriend
Text Generation
•
Updated
Feb 17
•
755
•
18
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
•
Updated
Feb 19
•
927
•
44
unsloth/gemma-2b-bnb-4bit
Text Generation
•
Updated
28 days ago
•
6.72k
•
15
unsloth/gemma-2b-it-bnb-4bit
Text Classification
•
Updated
28 days ago
•
2.51k
•
18
alexandreteles/bonito-v1-awq
Text2Text Generation
•
Updated
Mar 16
•
173
•
2
CohereForAI/c4ai-command-r-v01-4bit
Text Generation
•
Updated
4 days ago
•
514
•
166
mlabonne/Jambatypus-v0.1
Text Generation
•
Updated
Apr 4
•
12
•
37
CohereForAI/c4ai-command-r-plus-4bit
Text Generation
•
Updated
4 days ago
•
406
•
240
unsloth/llama-3-8b-bnb-4bit
Text Generation
•
Updated
28 days ago
•
128k
•
177
TechxGenus/Meta-Llama-3-8B-GPTQ
Text Generation
•
Updated
Apr 19
•
627
•
4
dattaraj/Gemma-2b-it-mental-health
Text Generation
•
Updated
Apr 22
•
25
•
1
neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
Updated
Jun 10
•
158k
•
11
lllyasviel/omost-llama-3-8b-4bits
Text Generation
•
Updated
May 29
•
4.85k
•
17
nikravan/glm-4vq
Document Question Answering
•
Updated
Jun 16
•
1.88k
•
16
anyisalin/L3-70B-Euryale-v2.1-AWQ
Text Generation
•
Updated
Jun 18
•
88
•
3
dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-bnb-4bit
Text Generation
•
Updated
Jun 27
•
13
•
1
unsloth/gemma-2-9b-bnb-4bit
Text Generation
•
Updated
28 days ago
•
25.4k
•
22
solidrust/Phi-3-mini-128k-instruct-AWQ
Text Generation
•
Updated
28 days ago
•
102
•
1
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
•
Updated
Jul 17
•
90
•
5
shuyuej/Meta-Llama-3.1-70B-Instruct-GPTQ
Text Generation
•
Updated
3 days ago
•
627
•
2
Previous
1
2
3
4
5
...
502
Next