Safetensors for mixtral don't work with vllm. Can you upload .pt files?
· Sign up or log in to comment