1. An image processing apparatus comprising: a feature point extraction unit configured to extract feature points from an image to be discriminated; a holding unit configured to hold a table which defines information required to designate a moving destination of a feature point and a size of an image to be clipped at the moving destination for each feature point using feature points to be extracted; a calculation unit configured to calculate the moving destination of each of the extracted feature points and a size of an image to be clipped at the moving destination based on a definition in the table; a clipping unit configured to clip an image with the calculated size at the calculated moving destination as a local region; and a discrimination unit configured to discriminate an image similar to the image to be discriminated using a feature amount extracted from the local region.