In a more realistic and challenging scenario where the detectors cannot get the natural prompts, we propose a simple yet effective method to generate the prompt caption, which is named hybrid detection (“generated text”).
Concretely, we leverage the BLIP [1]} model to generate captions for us and then use this caption as the natural caption to train our hybrid detectors.
BLIP is a captioner which can generate synthetic captions.
In this way, we can still get the text information and our further experiments demonstrate that detectors trained on natural captions can also work well on the generated captions.
In our work, we leverage BLIP trained on ViT-B and CapFilt-L as our captioner.
