1. An apparatus for verifying an inspection result of a scanned image generated by scanning an image printed on a sheet, the apparatus comprising: an inspection result obtaining unit to obtain inspection result information indicating defect amount and defect position in the scanned image, from an inspection result of defect judgment of the scanned image with respect to an inspection reference image, the defect judgment being performed through dividing at least one of the scanned image and the inspection reference image into a plurality of areas and conducting position matching for each of the areas; and a verification unit to count defect amount occurring to the scanned image for each of the plurality of areas based on the obtained inspection result information, determine whether a defect pattern occurring to the scanned image matches a pre-set condition corresponding to a false defect detection condition causable by failure of the position matching, and determine that defect occurring to the scanned image is a false detection caused by failure of the position matching when the counted defect amount for each of the areas is a pre-set threshold value or more, and the defect pattern occurring to the scanned image matches the false defect detection condition.