1. An image processing method comprising: generating a target color image of a second viewpoint by warping a color image of a first viewpoint to the second viewpoint using a depth image corresponding to the color image of the first viewpoint; determining a conversion relationship of temporally neighboring color images among a plurality of color images of the second viewpoint, the plurality of color images including the target color image; and restoring a first hole of the target color image based on the conversion relationship.