Issue Loading Llama-3.2 (11B) Vision Instruct Model in Colab

#3
by Sampas - opened

Hello Unslooth Team,

I am attempting to load the Llama-3.2 (11B)-Vision-Instruct model in Colab, but I am encountering the following error:

RuntimeError: The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this model type.

Could you please confirm if this model is supported on Colab, or if there are specific configurations or dependencies I might be missing? I have updated the necessary libraries, but the issue persists.

I would appreciate your assistance in resolving this.

Best regards,
[Enes Tura]

Hey guys apologies for the delays. Vision models are now supported! :)

Read our blogpost: https://unsloth.ai/blog/vision
Tweet: https://x.com/UnslothAI/status/1859667930075758793
GitHub post: https://github.com/unslothai/unsloth/releases/tag/November-2024

is there any update on this?

Unsloth AI org

is there any update on this?

Still in the works - apologies.

hello , is there any update on this model ? or can you please inform me whenever the update model comes...

Unsloth AI org

hello , is there any update on this model ? or can you please inform me whenever the update model comes...

Yes we will let you guys know once it's supported so we can update all the model cards many thanks!

thank you :)

Hello, is there any progress?

Hello, is there any progress ?

Yes. It's done and ready to go but we need to announce it so this week for sure! :) I will notify you all

Hello, is there any progress ?

Hello, is there any progress?

Hello Unslooth Team,

I am attempting to load the Llama-3.2 (11B)-Vision-Instruct model in Colab, but I am encountering the following error:

RuntimeError: The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this model type.

Could you please confirm if this model is supported on Colab, or if there are specific configurations or dependencies I might be missing? I have updated the necessary libraries, but the issue persists.

I would appreciate your assistance in resolving this.

Best regards,
[Enes Tura]

is there any update on this?

Hey guys apologies for the delays. Vision models are now supported! :)

Read our blogpost: https://unsloth.ai/blog/vision
Tweet: https://x.com/UnslothAI/status/1859667930075758793
GitHub post: https://github.com/unslothai/unsloth/releases/tag/November-2024

Sign up or log in to comment