@inproceedings{
zhang2024generative,
title={Generative Active Learning for Image Synthesis Personalization},
author={Xulu Zhang and Wengyu Zhang and Xiaoyong Wei and Jinlin Wu and Zhaoxiang Zhang and Zhen Lei and Qing Li},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=CCypzvAlcU}
}
This paper presents a pilot study that explores the application of active learning, traditionally studied in the context of discriminative models, to generative models. We specifically focus on image synthesis personalization tasks. The primary challenge in conducting active learning on generative models lies in the open-ended nature of querying, which differs from the closed form of querying in discriminative models that typically target a single concept. We introduce the concept of anchor directions to transform the querying process into a semi-open problem. We propose a direction-based uncertainty sampling strategy to enable generative active learning and tackle the exploitation-exploration dilemma. Extensive experiments are conducted to validate the effectiveness of our approach, demonstrating that an open-source model can achieve superior performance compared to closed-source models developed by large companies, such as Google's StyleDrop. The source code is available at https://github.com/(open\_upon\_acceptance).
Generative Active Learning for Image Synthesis Personalization
Xulu Zhang Wengyu Zhang Xiaoyong Wei Jinlin Wu Zhaoxiang Zhang Zhen Lei Qing Li