1. A method for restoring an image, the method comprising: determining whether to perform an interpolation operation based on block information of a current image; restoring the current image by copying a reference image to a memory address of the current image assigned in a memory based on a determination result, the reference image being stored in the memory; and wherein the determining further comprises: deciding whether to skip loading of the reference image, deciding whether to skip generating of a predicted image, and deciding whether to skip generating of a residual image and restoring of the current image, based on the block information.