M1 Error while using device = "mps"

#72
by moshere - opened

I'm trying to run starcoder on MacbookPro M1 with 32GB.
While using device = "mps"
Getting the following error
RuntimeError: MPS does not support cumsum op with int64 input
All details here https://pastebin.com/Ejs8gvEe

Tried several ideas however this is still happening.
https://github.com/pytorch/pytorch/issues/96610
https://github.com/huggingface/transformers/issues/22502

Any instructions I can implement?

Thank you

Same issue here.

Same issue for me

Sign up or log in to comment