1. A method for predicting an enhancement layer image in an enhancement layer of a stereoscopic video signal using a lower layer image in a lower layer thereof, comprising the steps of: determining an optimal offset, x, between said enhancement layer image and said lower layer image according to one of (a) a minimum mean error between pixel values of said enhancement layer image and said lower layer image, and (b) a minimum mean squared error between pixel values of said enhancement layer image and said lower layer image; and shifting said lower layer image according to said optimal offset to obtain a reference image for use in disparity predicting the enhancement layer image.