RuntimeError: Expected one of cpu, cuda, ipu, xpu, mkldnn, opengl, opencl, ideep, hip, ve, fpga, ort, xla, lazy, vulkan, mps, meta, hpu, mtia, privateuseone device type at start of device string: auto

#14
by asadas - opened

Getting this with the script in the repo

Same here. I also created a fresh conda env with the latest version of every packages, and that is not helping.

yeah no idea, tried installing the latest transformers,torch etc, nothing works.

Issue is open at https://github.com/huggingface/transformers/issues/30350

I think it should use device_map instead of device. Not tested though.

can confirm

asadas changed discussion status to closed

Sign up or log in to comment