Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2.5-3B-Instruct-GGUF
like
22
Follow
Qwen
4,066
Text Generation
GGUF
English
chat
Inference Endpoints
conversational
arxiv:
2407.10671
License:
qwen-research
Model card
Files
Files and versions
Community
Deploy
Use this model
af75b7a
Qwen2.5-3B-Instruct-GGUF
2 contributors
History:
2 commits
feihu.hf
update README & LICENSE
af75b7a
2 months ago
.gitattributes
1.56 kB
upload weights
2 months ago
LICENSE
7.39 kB
update README & LICENSE
2 months ago
README.md
5.45 kB
update README & LICENSE
2 months ago
qwen2.5-3b-instruct-q2_k.gguf
1.38 GB
LFS
upload weights
2 months ago
qwen2.5-3b-instruct-q3_k_m.gguf
1.72 GB
LFS
upload weights
2 months ago
qwen2.5-3b-instruct-q4_0.gguf
2 GB
LFS
upload weights
2 months ago
qwen2.5-3b-instruct-q4_k_m.gguf
2.1 GB
LFS
upload weights
2 months ago
qwen2.5-3b-instruct-q5_0.gguf
2.38 GB
LFS
upload weights
2 months ago
qwen2.5-3b-instruct-q5_k_m.gguf
2.44 GB
LFS
upload weights
2 months ago
qwen2.5-3b-instruct-q6_k.gguf
2.79 GB
LFS
upload weights
2 months ago
qwen2.5-3b-instruct-q8_0.gguf
3.62 GB
LFS
upload weights
2 months ago
