1. Method for encoding video data having a base layer and an enhancement layer, wherein the base layer has lower color resolution and lower spatial resolution than the enhancement layer, the method comprising the steps of upsampling base layer information, wherein the upsampling refers to spatial resolution and to bit depth being the possible value range of each pixel, and wherein a predicted version of enhancement layer information is obtained that has higher bit depth and higher spatial resolution than the base layer; generating an enhancement layer residual being the difference between the enhancement layer information and said predicted version of enhancement layer information; and encoding the base layer information, the enhancement layer residual and an indication indicating whether spatial upsampling was done before or after bit depth upsampling.