ISTA-DASLab
/

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf / model.safetensors.index.json

BlackSamorez's picture

correct dtype + new dispatch + tokenizer

5133b63 9 months ago

263 kB

File too large to display, you can check the raw version instead.