Papers
arxiv:2309.05793

PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Models

Published on Sep 11, 2023
ยท Submitted by akhaliq on Sep 13, 2023
#1 Paper of the day
Authors:
,
,
,
,
,
,

Abstract

Personalized text-to-image generation has emerged as a powerful and sought-after tool, empowering users to create customized images based on their specific concepts and prompts. However, existing approaches to personalization encounter multiple challenges, including long tuning times, large storage requirements, the necessity for multiple input images per identity, and limitations in preserving identity and editability. To address these obstacles, we present PhotoVerse, an innovative methodology that incorporates a dual-branch conditioning mechanism in both text and image domains, providing effective control over the image generation process. Furthermore, we introduce facial identity loss as a novel component to enhance the preservation of identity during training. Remarkably, our proposed PhotoVerse eliminates the need for test time tuning and relies solely on a single facial photo of the target identity, significantly reducing the resource cost associated with image generation. After a single training phase, our approach enables generating high-quality images within only a few seconds. Moreover, our method can produce diverse images that encompass various scenes and styles. The extensive evaluation demonstrates the superior performance of our approach, which achieves the dual objectives of preserving identity and facilitating editability. Project page: https://photoverse2d.github.io/

Community

Awesome project, the identity preservation and editability seem to be really good.
Are you planning on releasing the code and/or the pretrained model ? The "Code" link in the header of the project page is broken :)

Same I'm also looking for github-code

Is there any estimation on when the code will be available?

Hi, we implemented an unofficial code for this paper - https://github.com/idonahum/photoVerse/tree/main . It is not perfect, we encourage you to use it and contribute :) Thanks.

@idonahum Thanks great

Customizing Images in Seconds: Dive into PhotoVerse's Magic!

Links ๐Ÿ”—:

๐Ÿ‘‰ Subscribe: https://www.youtube.com/@Arxflix
๐Ÿ‘‰ Twitter: https://x.com/arxflix
๐Ÿ‘‰ LMNT (Partner): https://lmnt.com/

By Arxflix
9t4iCUHx_400x400-1.jpg

Sign up or log in to comment

Models citing this paper 1

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2309.05793 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2309.05793 in a Space README.md to link it from this page.

Collections including this paper 15