1. An image processing device comprising: an image sensor configured to capture a plurality of pupil-divided images obtained from light fluxes passing through different pupil regions of an imaging optical system; and a selection unit configured to select an image to be used for image processing from the plurality of pupil-divided images, according to a position of an imaging area in the image sensor.