1. A face feature point detecting device comprising: an image input unit configured to input an image containing a face of a person; a feature point set candidate detecting unit configured to detect feature point set candidates each comprising plural kinds of feature points associated with the face, from the inputted image; a model information storage unit configured to store three-dimensional model information having information on kinds and positions of feature point components of plural faces on a three-dimensional model of the face; an error calculating unit configured to project the detected feature point set candidate on the three-dimensional model, and to calculate an error between each feature point of the projected feature point set candidate and each feature point of the feature point set including plural kinds of feature points of the three-dimensional model information; and a selecting unit configured to select one or more of the feature point set candidates as a feature point set having consistency so that a predetermined condition is satisfied by each of the errors of the feature points of the selected feature point set candidate or by an integral value of the errors for the selected feature point set candidate.