1. A spatial scalable video decoder, comprising: an upsampler for upsampling a low resolution prediction residual to form an upsampled prediction residual; a motion compensator for forming a motion compensated full resolution prediction; an adder, in signal communication with said upsampler and said motion compensator, for adding the upsampled prediction residual to the motion compensated full resolution prediction to form a full resolution decoded image block; a second motion compensator for forming a motion compensated low resolution prediction; and a second adder, in signal communication with said second motion compensator, for adding the low resolution prediction residual to the motion compensated low resolution prediction to form a low resolution decoded image block.