@inproceedings{
lu2024fcdfs,
title={{FC}-4{DFS}: Frequency-controlled Flexible 4D Facial Expression Synthesizing},
author={Xin Lu and Chuanqing Zhuang and Zhengda Lu and Yiqun Wang and Jun Xiao},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=4uHa1ANmV5}
}
4D facial expression synthesizing is a critical problem in the fields of computer vision and graphics. Current methods lack flexibility and smoothness when simulating the inter-frame motion of expression sequences. In this paper, we propose a frequency-controlled 4D facial expression synthesizing method, FC-4DFS. Specifically, we introduce a frequency-controlled LSTM network to generate 4D facial expression sequences frame by frame from a given neutral landmark with a given length. Meanwhile, we propose a temporal coherence loss to enhance the perception of temporal sequence motion and improve the accuracy of relative displacements. Furthermore, we designed a Multi-level Identity-Aware Displacement Network based on a cross-attention mechanism to reconstruct the 4D facial expression sequences from landmark sequences. Finally, our FC-4DFS achieves flexible and SOTA generation results of 4D facial expression sequences with different lengths on CoMA and Florence4D datasets. The code will be available on GitHub.
FC-4DFS: Frequency-controlled Flexible 4D Facial Expression Synthesizing
Xin Lu Chuanqing Zhuang Zhengda Lu Yiqun Wang Jun Xiao