Anyone had this error while trying to load model into pipeline?
I got this error and was stuck for several days when the model was loaded into memory. I have tried re-downloading the model files and still got this error. Any thoughts or solutions, thanks.
ValueError: Cannot load <class 'Pyramid_Flow.pyramid_dit.mmdit_modules.modeling_pyramid_mmdit.PyramidDiffusionMMDiT'> from Pyramid_Flow/Pyramid-Flow-Miniflux/diffusion_transformer_384p because the following keys are missing:
transformer_blocks.3.attn.norm_add_k.weight, transformer_blocks.5.attn.norm_add_k.weight, pos_embed.proj.weight, transformer_blocks.5.attn.norm_add_q.weight, transformer_blocks.7.attn.norm_add_q.weight, transformer_blocks.0.attn.norm_add_q.weight, transformer_blocks.6.attn.norm_add_q.weight, pos_embed.proj.bias, transformer_blocks.0.attn.norm_add_k.weight, transformer_blocks.1.attn.norm_add_k.weight, transformer_blocks.1.attn.norm_add_q.weight, transformer_blocks.3.attn.norm_add_q.weight, transformer_blocks.2.attn.norm_add_q.weight, transformer_blocks.6.attn.norm_add_k.weight, transformer_blocks.4.attn.norm_add_k.weight, transformer_blocks.7.attn.norm_add_k.weight, transformer_blocks.2.attn.norm_add_k.weight, transformer_blocks.4.attn.norm_add_q.weight.
Please make sure to pass low_cpu_mem_usage=False and device_map=None if you want to randomly initialize those weights or else make sure your checkpoint file is correct.