Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
awq
4-bit precision
AutoTrain Compatible
text-generation-inference
Inference Endpoints
custom_code
Merge
Eval Results
Mixture of Experts
8-bit precision
Carbon Emissions
Misc with no match
text-embeddings-inference
Apply filters
Models
3,465
Full-text search
Edit filters
Sort: Trending
Active filters:
awq
Clear all
Qwen/Qwen2.5-32B-Instruct-AWQ
Text Generation
•
Updated
5 days ago
•
3.56k
•
22
Qwen/Qwen2.5-72B-Instruct-AWQ
Text Generation
•
Updated
11 days ago
•
3.32k
•
15
Qwen/Qwen2-VL-72B-Instruct-AWQ
Image-Text-to-Text
•
Updated
5 days ago
•
5.04k
•
14
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
Updated
5 days ago
•
16.7k
•
25
TheBloke/Yarn-Mistral-7B-128k-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
693
•
71
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
Updated
Aug 7
•
373k
•
55
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
•
Updated
Aug 7
•
144k
•
75
Qwen/Qwen2.5-0.5B-Instruct-AWQ
Text Generation
•
Updated
11 days ago
•
420
•
3
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation
•
Updated
11 days ago
•
2.39k
•
4
TheBloke/llama2_70b_chat_uncensored-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
23
•
6
TheBloke/Wizard-Vicuna-13B-Uncensored-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
49
•
13
TheBloke/fin-llama-33B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
10
•
5
TheBloke/MetaMath-Mistral-7B-AWQ
Text Generation
•
Updated
Nov 9, 2023
•
32
•
1
TheBloke/deepseek-coder-6.7B-instruct-AWQ
Text Generation
•
Updated
Nov 13, 2023
•
1.86k
•
15
ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
Dec 12, 2023
•
21.2k
•
15
TheBloke/dolphin-2.6-mistral-7B-AWQ
Text Generation
•
Updated
Dec 28, 2023
•
191
•
8
alexandreteles/bonito-v1-awq
Text2Text Generation
•
Updated
Mar 16
•
175
•
2
anyisalin/L3-70B-Euryale-v2.1-AWQ
Text Generation
•
Updated
Jun 18
•
89
•
3
solidrust/Phi-3-mini-128k-instruct-AWQ
Text Generation
•
Updated
27 days ago
•
98
•
1
dahara1/llama3.1-8b-Instruct-awq
Text Generation
•
Updated
Jul 29
•
63
•
2
team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-AWQ
Text Generation
•
Updated
27 days ago
•
929
•
1
solidrust/gemma-2-9b-it-AWQ
Text Generation
•
Updated
27 days ago
•
1.4k
•
2
solidrust/Hermes-3-Llama-3.1-8B-AWQ
Text Generation
•
Updated
27 days ago
•
1.77k
•
3
Qwen/Qwen2.5-1.5B-Instruct-AWQ
Text Generation
•
Updated
11 days ago
•
161
•
2
Qwen/Qwen2.5-3B-Instruct-AWQ
Text Generation
•
Updated
11 days ago
•
479
•
2
Qwen/Qwen2.5-14B-Instruct-AWQ
Text Generation
•
Updated
11 days ago
•
34.3k
•
6
AMead10/c4ai-command-r-08-2024-awq
Text Generation
•
Updated
12 days ago
•
58
•
1
solidrust/LLama-3.1-8B-Matrix-AWQ
Text Generation
•
Updated
11 days ago
•
9
•
1
Qwen/Qwen2.5-Coder-7B-Instruct-AWQ
Text Generation
•
Updated
5 days ago
•
1.83k
•
1
Orion-zhen/Qwen2.5-Coder-7B-Instruct-AWQ
Text Generation
•
Updated
10 days ago
•
156
•
1
Previous
1
2
3
...
116
Next