-
-
-
-
-
-
Inference status
Active filters:
4-bit
Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
6.34k
•
11
MaziyarPanahi/solar-pro-preview-instruct-GGUF
Text Generation
•
Updated
•
8.64k
•
16
Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
5.23k
•
4
Qwen/Qwen2.5-0.5B-Instruct-AWQ
Text Generation
•
Updated
•
523
•
3
unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit
Text Generation
•
Updated
•
257
•
3
unsloth/Llama-3.2-3B-bnb-4bit
Text Generation
•
Updated
•
6.21k
•
2
SeanScripts/Llama-3.2-11B-Vision-Instruct-nf4
Image-Text-to-Text
•
Updated
•
838
•
2
ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1-GPTQ_Q4
Updated
•
54
•
2
Precacons/Pico-Lamma-3.2-1B-Reasoning-Instruct
Updated
•
123
•
2
TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
31
•
91
TheBloke/airoboros-l2-13b-gpt4-m2.0-GPTQ
Text Generation
•
Updated
•
17
•
29
TheBloke/CodeLlama-13B-Instruct-GPTQ
Text Generation
•
Updated
•
888
•
38
Qwen/Qwen-VL-Chat-Int4
Text Generation
•
Updated
•
4.72k
•
88
TheBloke/Falcon-180B-Chat-GPTQ
Text Generation
•
Updated
•
70
•
69
TheBloke/llama2_70b_chat_uncensored-AWQ
Text Generation
•
Updated
•
26
•
6
TheBloke/Wizard-Vicuna-13B-Uncensored-AWQ
Text Generation
•
Updated
•
48
•
13
TheBloke/fin-llama-33B-AWQ
Text Generation
•
Updated
•
10
•
5
TheBloke/storytime-13B-GPTQ
Text Generation
•
Updated
•
462
•
27
TheBloke/Mistral-7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
•
289k
•
76
TheBloke/llava-v1.5-13B-AWQ
Text Generation
•
Updated
•
137
•
32
TheBloke/llava-v1.5-13B-GPTQ
Text Generation
•
Updated
•
135
•
35
TheBloke/zephyr-7B-beta-GPTQ
Text Generation
•
Updated
•
13.3k
•
55
TheBloke/MetaMath-Mistral-7B-AWQ
Text Generation
•
Updated
•
33
•
1
TheBloke/deepseek-coder-6.7B-instruct-AWQ
Text Generation
•
Updated
•
2.64k
•
15
TheBloke/deepseek-coder-6.7B-base-AWQ
Text Generation
•
Updated
•
10.2k
•
8
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
•
109k
•
130
ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
•
22k
•
15
TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ
Text Generation
•
Updated
•
117
•
97
TheBloke/DaringMaid-20B-GPTQ
Text Generation
•
Updated
•
25
•
5
unsloth/codellama-34b-bnb-4bit
Text Generation
•
Updated
•
543
•
3