1. An image processing apparatus comprising: a calculating unit configured to calculate an evaluation amount of red eye for every pixel satisfying a predetermined condition in an image; an extracting unit configured to extract a candidate pixel having red eye including a pupil on the basis of the evaluation amount; and one or more processors programmed to control at least one of the calculating unit and extracting unit, wherein the evaluation amount is calculated from only red and green components of the pixel in the image and without a blue component of the pixel in the image.