Running this on mobile

#2
by enricorampazzo - opened

Hello,
I tried to convert this model to be used with mlc-llm, but I think this architecture is not supported yet. Is there any other way to run this locally from a mobile device?

Thanks,

Enrico

Sign up or log in to comment