@inproceedings{
luo2024codeswap,
title={CodeSwap: Symmetrically Face Swapping Based on Prior Codebook},
author={Xiangyang Luo and Xin Zhang and Yifan Xie and Xinyi Tong and Weijiang Yu and Heng Chang and Fei Ma and Fei Richard Yu},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=TYbuVVM3iR}
}
Face swapping, the technique of transferring the identity from one face to another, merges as a field with significant practical applications. However, previous swapping methods often result in visible artifacts. To address this issue, in our paper, we propose $CodeSwap$, a symmetrical framework to achieve face swapping with high-fidelity and realism. Specifically, our method firstly utilizes a codebook that captures the knowledge of high quality facial features. Building on this foundation,  the face swapping is then converted into the code manipulation task in a code space. To achieve this, we design a Transformer-based architecture to update each code independently, which enable more precise manipulations. Furthermore, we incorporate a mask generator to achieve seamless blending of the generated face with the background of target image.
A distinctive characteristic of our method is its symmetrical approach to processing both target and source images, simultaneously extracting information from each to improve the quality of face swapping. 
This symmetry also simplifies the bidirectional exchange of faces in a singular operation.
Through extensive experiments on ClelebA-HQ and FF++, our method is proven to not only achieve efficient identity transfer but also substantially reduce the visible artifacts.
CodeSwap: Symmetrically Face Swapping Based on Prior Codebook
Xiangyang Luo Xin Zhang Yifan Xie Xinyi Tong Weijiang Yu Heng Chang Fei Ma Fei Richard Yu