1. An apparatus removing noise of an image, comprising: a color image division unit to divide an inputted color image into a plurality of channel images including a first channel image and a second channel image; a channel image correction unit to correct the second channel image using the first channel image; a noise removal unit to remove noise of the first channel image, using the corrected second channel image and the first channel image; and a color image reconstruction unit to reconstruct a color image in which noise is removed, based on the noise-removed first channel image and the corrected second channel image, wherein the first channel image is a current channel image to be processed, and wherein the channel image correction unit corrects the second channel images to replace an image corresponding to a low frequency band from among the second channel images with an image corresponding to a low frequency band from among the first channel images.