@inproceedings{
tan2024blind,
title={Blind Face Video Restoration with Temporal Consistent Generative Prior and Degradation-Aware Prompt},
author={Jingfan Tan and Hyunhee Park and Ying Zhang and Tao Wang and Kaihao Zhang and Xiangyu Kong and Pengwen Dai and Zikun Liu and Wenhan Luo},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=qaIS3nvAem}
}
Within the domain of blind face restoration (BFR), approaches lacking facial priors frequently result in excessively smoothed visual outputs.Exiting BFR methods predominantly utilize generative facial priors to achieve realistic and authentic details. However, these methods, primarily designed for images, encounter challenges in maintaining temporal consistency when applied to face video restoration. To tackle this issue, we introduce StableBFVR, an innovative Blind Face Video Restoration method based on Stable Diffusion that incorporates temporal information into the generative prior. This is achieved through the introduction of temporal layers in the diffusion process.These temporal layers consider both long-term and short-term information aggregation.Moreover, to improve generalizability, BFR methods employ complex, large-scale degradation during training, but it often sacrifices accuracy. Addressing this, StableBFVR features a novel mixed-degradation-aware prompt module, capable of encoding specific degradation information to dynamically steer the restoration process.Comprehensive experiments demonstrate that our proposed StableBFVR outperforms state-of-the-art methods.
Blind Face Video Restoration with Temporal Consistent Generative Prior and Degradation-Aware Prompt
Jingfan Tan Hyunhee Park Ying Zhang Tao Wang Kaihao Zhang Xiangyu Kong Pengwen Dai Zikun Liu Wenhan Luo