Hugging Face's logo

DrNicefellow
/
Qwen1.5-32B-Chat-3.5bpw-exl2

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Qwen1.5-32B-Chat-3.5bpw-exl2 / README.md
DrNicefellow's picture
DrNicefellow
Create README.md
20b0994 verified
preview code
|
raw
history blame contribute delete
827 Bytes
metadata
license: other
license_name: tongyi-qianwen
license_link: https://huggingface.co/Qwen/Qwen1.5-32B-Chat/blob/main/LICENSE

Qwen1.5-32B-Chat-3.5bpw-exl2

This is a 3.5bpw quantized version of Qwen/Qwen1.5-32B-Chat made with exllamav2.

To run this, make sure you installed the up-to-date version of Exllamav2.

License

This project is distributed under the Tongyi Qianwen LICENSE AGREEMENT. See the LICENSE file for more information.

Feeling Generous? 😊

Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?