1. A face center position detecting device comprising: a face image storage unit that stores images obtained by photographing a face; a contour determining unit that processes the images stored in the face image storage unit and obtains positions of contours in a lateral direction of the face images; a wearing glasses determining unit that determines whether or not glasses are being worn on faces of the images stored in the face image storage unit; a sideways orientation determining unit that determines whether or not a face of the face images stored in the face image storage unit is facing sideways; and a center position detecting unit that detects a center position of the face based on images for a lower part of a face of the face images stored in the face image storage unit and for regions between contour positions obtained by the contour determining unit when the wearing glasses determining unit determines that glasses are being worn on the face of the face image and the sideways orientation determining unit determines that the face of the face image is facing sideways.