1. An image data management apparatus for managing a plurality of image data, comprising: a reading unit configured to read identification information unique to an image-capturing apparatus which captured the image data, and image-capturing location information indicating an image-capturing location of the image data, the identification information and the image-capturing location information being related to the image data; a determination unit configured to determine a non-image-capturing location for an image-capturing apparatus corresponding to specific identification information on the basis of the image-capturing location information of image data related to the specific identification information; and an extraction unit configured to extract, from among image data related to other identification information that is different from the specific identification information, image data whose image-capturing locations exists in the non-image-capturing location.