Qwen Separation, understanding modeling

#5
by SinanAkkoyun - opened

Thank you for your awesome work, truly revolutionary

I'd like to separate the Qwen part but found it difficult to see similarities between modeling_qwen and modeling_molmo
Would you be so kind to guide me oj separating the Clip, MLP and Qwen weights? Thanks :)

SinanAkkoyun changed discussion status to closed

Sign up or log in to comment