1. A method of processing video data, comprising: receiving a first video frame and a second video frame, wherein the video frames each comprise a plurality of blocks of pixels; obtaining motion information identifying a matching block in the second frame for each block in a group of blocks in the first frame; computing a measure related to an overlap area of each of the blocks belonging to the group of blocks in the first frame with a block of pixels to be constructed in a third frame by translating matching blocks to the third frame based on the obtained motion information; and classifying the block of pixels to be constructed in the third frame according to a degree of occlusion based at least in part on the computed overlap area measures.