Explicitly set lang adapter bias to False
#7
by
patrickvonplaten
- opened
Thanks for spotting this @ArthurZ
This comment has been hidden
vllm serve mistralai/Pixtral-Large-Instruct-2411 --tokenizer_mode mistral --limit_mm_per_prompt 'image=10' --tensor-parallel-size 8 --tool-call-parser mistral --enable-auto-tool-choice --config-format mistral --load-format mistral --revision refs/pr/7
Can be run with: https://github.com/vllm-project/vllm/pull/10449
This should be fully compatible actually with current vllm version so it can be safely merged.
patrickvonplaten
changed pull request status to
merged