1. Method for encoding video data containing high-pass frames and low-pass frames as obtained by temporal wavelet decomposition using motion compensated temporal filtering, wherein the encoding is based on prediction and update steps, the method comprising the steps of encoding the low-pass frames, wherein residual prediction on frame level may be used; splitting the high-pass frames into two interleaving frame groups; encoding the frames of the first of said frame groups, wherein residual prediction on frame level may be used; and encoding the frames of the second of the frame groups using an encoding method without residual prediction.