1. An apparatus, comprising: an encoder for encoding an image region of a picture, said encoder having a prediction refinement filter for refining at least one of an intra prediction and an inter prediction for the image region, wherein said prediction refinement filter refines the inter prediction for the image region using at least one of previously decoded data and previously encoded data, the previously decoded data and the previously encoded data corresponding to pixel values in neighboring regions with respect to the image region.