How can I run pretrained model on multi GPUs?
#38
by
NorzY
- opened
As title. I used device_map="auto" while call SpeechT5ForTextToSpeech.from_pretrained(), but got error
"An error occurred while model initilization: SpeechT5ForTextToSpeech does not support device_map='auto'
. To implement support, the model class needs to implement the _no_split_modules
attribute."