In Section REF , we explain the sound-guided image manipulation step. Given the multi-modal joint embedding space, we use a direct latent code optimization method to manipulate images guided by an audio input. For example, a facial expression of a portrait photo is manipulated according to sound inputs, e.g., giggling or sobbing, as shown in Fig. REF . Note that our approach may be similar to existing text-guided image manipulation models, including StyleCLIP [1]}, but we focus on exploring a novel modality, i.e., sound.
