Get an nan image after vae

#38
by Number18-tong - opened

I loaded the required pretrained models and initialized StableDiffusionXLPipeline with these models. Show as bellow picture.
image.png
And no matter what prompt I enter, the result is a black image, I found the image after vae is nan, if i change the vae pretrained model(eg. changed to sd1.5) , the result is correct but unclear. Someone knows how to solve this problem? Thanks very much!

I am using stabilityai/sdxl-vae and have no issues with that

same issue here

I solve the problem by using the vae model in https://huggingface.co/madebyollin/sdxl-vae-fp16-fix

Seems that turning of amp and only using fp32 also works

Sign up or log in to comment