thesven
/

Qwen1.5-0.5B-Chat-GGUF

Inference Endpoints

Model card Files Files and versions Community

Qwen1.5-0.5B-Chat-GGUF

1 contributor

History: 2 commits

thesven's picture

Upload folder using huggingface_hub

8ee571d verified 6 months ago

.gitattributes

2.15 kB

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-IQ1_S.gguf

231 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-IQ2_S.gguf

278 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-IQ2_XS.gguf

255 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-IQ3_S.gguf

333 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-IQ3_XXS.gguf

296 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-IQ4_NL.gguf

395 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-IQ4_XS.gguf

380 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-Q4_K_M.gguf

407 MB
LFS

Upload folder using huggingface_hub 6 months ago
Qwen1.5-0.5B-Chat-GGUF-bf16.gguf

1.25 GB
LFS

Upload folder using huggingface_hub 6 months ago
imatrix_Qwen1.5-0.5B-Chat.dat

866 kB

Upload folder using huggingface_hub 6 months ago