Custom Diffusion / Multi-Concept Customization of Text-to-Image Diffusion
Lickety Split Review arXiv:2212.04488 Problem: Dreambooth and Textual Inversion struggle dealing with multiple new concepts for fine-tuning Solution:
• Train only the Key and Value matrices in cross-attention layers
• Add new composition objective for multiple concepts
• Choose real images for regularization The first important thing that the authors…
Custom Diffusion / Multi-Concept Customization of Text-to-Image Diffusion Lickety Split Review arXiv:2212.04488 Problem: Dreambooth and Textual Inversion struggle dealing with multiple new concepts for fine-tuning Solution:
• Train only the Key and Value matrices in cross-attention layers
• Add new composition objective for multiple concepts
• Choose real images for regularization The first important thing that the authors… machine-learning
Custom Diffusion MultiConcept Customization TexttoImage Diffusion Lickety Split Review arXiv221204488 Problem Dreambooth Textual Inversion struggle dealing multiple new concept finetuning Solution • Train Key Value matrix crossattention layer • Add new composition objective multiple concept • Choose real image regularization first important thing authors… machinelearning