1. An apparatus removing noise of an image, comprising: a channel image correction unit to correct remaining channel images excluding a currently processed channel image from among a plurality of channel images using the currently processed channel image; a noise removal unit to remove noise of the currently processed channel image, using the corrected remaining channel images and the currently processed channel image; and a color image reconstruction unit to reconstruct a color image in which noise is removed, by combining the plurality of channel images in which noise is removed when the noise of the plurality of channel images is removed.