lavawolfiee
/

Mixtral-8x7B-Instruct-v0.1-offloading-demo

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-offloading-demo

Commit History

Update README.md

3d47c83

lavawolfiee commited on Dec 30, 2023

Create README.md

55e801c

lavawolfiee commited on Dec 30, 2023

Added quantization_config.json

333ea85

lavawolfiee commited on Dec 30, 2023

Upload folder using huggingface_hub

e15ef64

lavawolfiee commited on Dec 17, 2023

initial commit

fc3323c

lavawolfiee commited on Dec 17, 2023