-
-
-
-
-
-
Inference status
Active filters:
gptq
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
1.85k
•
7
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
Updated
•
510
•
559
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
1.29k
•
6
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
•
7.54k
•
315
TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
269
•
138
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
Updated
•
47k
•
49
ModelCloud/gemma-2-27b-it-gptq-4bit
Text Generation
•
Updated
•
3.03k
•
10
Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
6.34k
•
11
Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
5.23k
•
4
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
1.2k
•
7
ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1-GPTQ_Q4
Updated
•
54
•
2
TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
31
•
91
TheBloke/airoboros-l2-13b-gpt4-m2.0-GPTQ
Text Generation
•
Updated
•
17
•
29
TheBloke/CodeLlama-13B-Instruct-GPTQ
Text Generation
•
Updated
•
888
•
38
Qwen/Qwen-VL-Chat-Int4
Text Generation
•
Updated
•
4.72k
•
88
TheBloke/Falcon-180B-Chat-GPTQ
Text Generation
•
Updated
•
70
•
69
TheBloke/storytime-13B-GPTQ
Text Generation
•
Updated
•
462
•
27
TheBloke/Mistral-7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
•
289k
•
76
TheBloke/llava-v1.5-13B-GPTQ
Text Generation
•
Updated
•
135
•
35
TheBloke/zephyr-7B-beta-GPTQ
Text Generation
•
Updated
•
13.3k
•
55
01-ai/Yi-6B-Chat-8bits
Text Generation
•
Updated
•
201
•
9
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
•
109k
•
130
TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ
Text Generation
•
Updated
•
117
•
97
TheBloke/DaringMaid-20B-GPTQ
Text Generation
•
Updated
•
25
•
5
TheBloke/openchat-3.5-0106-GPTQ
Text Generation
•
Updated
•
151
•
7
TheBloke/phi-2-electrical-engineering-GPTQ
Text Generation
•
Updated
•
16
•
7
Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4
Text Generation
•
Updated
•
89
•
12
TechxGenus/Meta-Llama-3-8B-GPTQ
Text Generation
•
Updated
•
627
•
4
neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
Updated
•
158k
•
11
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
•
Updated
•
90
•
5