Limitation and future work:    We provide an error analysis in Appendix  and a discussion on societal impact in Appendix . PromptGen is restricted by the pre-trained generative model's coverage [1]}, [2]}.
PromptGen focuses on mode-seeking and -reweighting instead of domain adaptation, and it is possible to combine PromptGen and domain adaptation of generative models [3]}.
Also, PromptGen depends on the off-the-shelf models that provide knowledge about the control (Appendix ).
In subsequent work, it can be beneficial to explore how to learn energy functions [4]}, [5]} (besides our moment constraint used for de-biasing), which may provide fine-grained control with less bias.
