lavawolfiee
/

Mixtral-8x7B-Instruct-v0.1-offloading-hqq-4bit-3bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-offloading-hqq-4bit-3bit

Commit History

Update README.md

d2214d5

lavawolfiee commited on Dec 30, 2023

Added quantization_config.json

ee0081f

lavawolfiee commited on Dec 30, 2023

Upload folder using huggingface_hub

6e8b681

lavawolfiee commited on Dec 26, 2023

Create README.md

380e4d8

lavawolfiee commited on Dec 26, 2023

initial commit

35d82eb

lavawolfiee commited on Dec 26, 2023