Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
dranger003
/
Qwen1.5-72B-Chat-iMat.GGUF
like
11
Text Generation
GGUF
Inference Endpoints
conversational
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
2
Deploy
Use this model
a89104f
Qwen1.5-72B-Chat-iMat.GGUF
2 contributors
History:
28 commits
dranger003
Upload ggml-qwen1.5-72b-chat-iq2_s.gguf with huggingface_hub
a89104f
verified
8 months ago
groups_merged
Move previous imatrix files.
8 months ago
.gitattributes
2.23 kB
Upload ggml-qwen1.5-72b-chat-iq3_m.gguf with huggingface_hub
8 months ago
README.md
1.25 kB
Update README.md
8 months ago
ggml-qwen1.5-72b-chat-f16-imatrix.dat
23.6 MB
LFS
Upload ggml-qwen1.5-72b-chat-f16-imatrix.dat with huggingface_hub
8 months ago
ggml-qwen1.5-72b-chat-iq2_s.gguf
23.4 GB
LFS
Upload ggml-qwen1.5-72b-chat-iq2_s.gguf with huggingface_hub
8 months ago
ggml-qwen1.5-72b-chat-iq2_xs.gguf
21.7 GB
LFS
Upload ggml-qwen1.5-72b-chat-iq2_xs.gguf with huggingface_hub
8 months ago
ggml-qwen1.5-72b-chat-iq2_xxs.gguf
19.8 GB
LFS
Upload ggml-qwen1.5-72b-chat-iq2_xxs.gguf with huggingface_hub
8 months ago
ggml-qwen1.5-72b-chat-iq3_m.gguf
33.9 GB
LFS
Upload ggml-qwen1.5-72b-chat-iq3_m.gguf with huggingface_hub
8 months ago
ggml-qwen1.5-72b-chat-iq3_s.gguf
31.6 GB
LFS
Upload ggml-qwen1.5-72b-chat-iq3_s.gguf with huggingface_hub
8 months ago
ggml-qwen1.5-72b-chat-iq3_xs.gguf
29.9 GB
LFS
Upload ggml-qwen1.5-72b-chat-iq3_xs.gguf with huggingface_hub
8 months ago
ggml-qwen1.5-72b-chat-iq3_xxs.gguf
27.7 GB
LFS
Upload ggml-qwen1.5-72b-chat-iq3_xxs.gguf with huggingface_hub
8 months ago
