Predicting human gaze using quaternion DCT image signature saliency and face detection
We combine and extend the previous work on DCT based image signatures and face detection to determine the visual saliency. To this end, we transfer the scalar definition of image signatures to quaternion images and thus introduce a novel saliency method using quaternion type II DCT image signatures. Furthermore, we use MCT based face detection to model the important influence of faces on the visual saliency using rotated elliptical Gaussian weight functions and evaluate several integration schemes. In order to demonstrate the performance of the proposed methods, we evaluate our approach on the Bruce Tsotsos (Toronto) [2] and Cerf (FIFA) [3] benchmark eye tracking data sets. Additionally, we present evaluation results on the Bruce Tsotsos data set of the most important spectral saliency approaches. We achieve state of the art results in terms of the well established area under curve (AUC) measure on the Bruce Tsotsos data set and come close to the ideal AUC on the Cerf data set with less than one millisecond to calculate the bottom up QDCT saliency map.
2012 IEEE Workshop on the Applications of Computer Vision (WACV)