Text Generation
Transformers
Safetensors
imp
custom_code

Android tar file for Imp-v1.5-3B-196

#2
by NSTiwari - opened

Hi @MILVLG ,
I came across MLC-IMP for on-device deployment of Imp model. That's impressive.

Could you kindly share the Android .tar file for Imp-v1.5-3B-196 model? I'm facing issues with the steps to convert and compile the model.

Thanks for your help.

Hi @MILVLG ,
I came across MLC-IMP for on-device deployment of Imp model. That's impressive.

Could you kindly share the Android .tar file for Imp-v1.5-3B-196 model? I'm facing issues with the steps to convert and compile the model.

Thanks for your help.

Thanks for your issue. Maybe I can give you the final apk.

If you still insist on compiling it yourself, you can provide me some error messages.

Hi @MILVLG ,
Thanks for the final APK. However, I still need your help in compiling the model.

I'm trying to convert the weights but I'm unable to customize the scripts for MLC-LLM to convert the model weights to type imp, the error is imp model type not supported.
I would appreciate if you can help in this matter.

Hi @MILVLG ,
Thanks for the final APK. However, I still need your help in compiling the model.

I'm trying to convert the weights but I'm unable to customize the scripts for MLC-LLM to convert the model weights to type imp, the error is imp model type not supported.
I would appreciate if you can help in this matter.

We currently have no plans to pull it to MLC-LLM.
If you want to start from scratch, I recommend using our mlc-imp .

Sign up or log in to comment