1. An apparatus for processing an image, the apparatus comprising: a candidate pixel setting unit to set a plurality of candidate pixels corresponding to at least one hole pixel in a hole area using neighboring pixels around the hole area using at least one pair of neighboring pixels in a symmetric arrangement with respect to the hole pixel among the neighboring pixels; and a pixel value determining unit to determine a pixel value of the hole pixel using the plurality of candidate pixels.