1. An image processing apparatus for reconstructing a deteriorated image including an image of an object, comprising: a measuring unit that measures a distance to the object, thereby setting a distance layer to which the object belongs; an image reconstructing unit that reconstructs the deteriorated image by repetitive calculations; and an end discriminating unit that discriminates an end of the repetitive calculations by the image reconstructing unit, wherein the end discriminating unit makes the end discrimination only to a specific distance layer among the distance layers or to each of the distance layers.