1. An image processing device comprising: a feature point detection unit configured to detect feature points from an image; a reliability computation unit configured to compute reliability of each of the detected feature points; and a removal processing unit configured to remove some of the detected feature points on the basis of the reliability so that the number of the remaining feature points in each split region that is obtained by splitting the image into a plurality of regions is within a restricted number of feature points.