Transferring from face recognition to face attribute prediction through adaptive selection of off the shelf CNN representations
This paper addresses the problem of transferring CNNs pre trained for face recognition to a face attribute prediction task. To transfer an off the shelf CNN to a novel task, a typical solution is to fine tune the network towards the novel task. As demonstrated in the state of the art face attribute prediction approach, fine tuning the high level CNN hidden layer by using labeled attribute data leads to significant performance improvements. In this paper, however, we tackle the same problem but through a different approach. Rather than using an end to end network, we select face descriptors from off the shelf hierarchical CNN representations for recognizing different attributes. Through such an adaptive representation selection, even without any fine tuning, our results still outperform the state of the art face attribute prediction approach on the latest large scale dataset for an error rate reduction of more than 20% Moreover, by using intensive empirical probes, we have identified several key factors that are significant for achieving promising face attribute prediction performance. These results attempt to gain and update our understandings of the nature of CNN features and how they can be better applied to the transferred novel tasks.
2016 23rd International Conference on Pattern Recognition (ICPR)