1. A face recognition apparatus that recognizes faces of a plurality of persons, comprising: an image sequence acquiring unit configured to acquire respective image sequences picked up in time series by respective cameras; a face image acquiring unit configured to acquire respective face image sets including face images from the respective image sequences; an intra-sequence classifying unit configured to classify the face images in the respective face image sets into fragmental face image sets each including the face images having high correlation with each other; an inter-sequence classifying unit configured to classify the fragmental face image sets into integrated sets each including the fragmental face image sets having high correlation with each other; a reference image storing unit configured to store respective reference face image sets of respective persons acquired in advance for identification; an identification unit configured to compare the respective integrated sets with the reference face image sets to identify the persons.