CalamitousFelicitousness
/

Qwen2-VL-72B-Instruct-GPTQ-Int4-tpfix

Image-Text-to-Text

4-bit precision

Model card Files Files and versions Community

intermediate_size which was incompatible with VLLM parallel inference

#1

by cduk - opened 9 days ago

cduk

9 days ago

Can someone please explain what the intermediate_size issue is?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment