1. A residue image downsampling method comprising: generating a residue corresponding to the difference between an original image and a predicted image, for each image component of the original image formed with at least two or more image components; and downsampling the residue for each image component at a predetermined ratio.