@inproceedings{
hu2024finegrained,
title={Fine-Grained Promote Learning for Face Anti-Spoofing},
author={Xueli Hu and Huan Liu and Haocheng Yuan and Zhiyang Fu and Yizhi Luo and Ning Zhang and Hang Zou and Gan Jianwen and Yuan Zhang},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=shcoBmaF3s}
}
There has been an increasing focus from researchers on Domain-Generalized (DG) Face Anti-Spoofing (FAS). However, existing methods aim to project a shared visual space through adversarial training, making it difficult to explore the space without losing semantic information. We investigate the inadequacies of DG that result from classifier overfitting to a significantly different domain distribution. To address this issue, we propose a novel Fine-Grained Prompt Learning (FGPL) based on Vision-Language Models (VLMs), such as CLIP, which can adaptively adjust weights for classifiers with text features to mitigate overfitting. Specifically, FGPL first motivates the prompts to learn content and domain semantic information by capturing Domain-Agnostic and Domain-Specific features. Furthermore, our prompts are designed to be category-generalized by diversifying the Domain-Specific prompts. Additionally, we design an Adaptive Convolutional Adapter (AC-adapter), which is implemented through an adaptive combination of Vanilla Convolution and Central Difference Convolution, to be inserted into the image encoder for quickly bridging the gap between general image recognition and FAS task. Extensive experiments demonstrate that the proposed FGPL is effective and outperforms state-of-the-art methods on several cross-domain datasets.
Fine-Grained Prompt Learning for Face Anti-Spoofing
Xueli Hu Huan Liu Haocheng Yuan Zhiyang Fu Yizhi Luo Ning Zhang Hang Zou Gan Jianwen Yuan Zhang