1. A method for encoding or decoding video content, the method comprising: determining a set of interpolation filters for use in interpolating sub-pel pixel values and a mapping between interpolation filters in the set of interpolation filters and different sizes of prediction units (PUs) of video content; receiving a PU of video content; determining a size of the received PU; and determining an interpolation filter in the set of interpolation filters based on a mapping between the interpolation filter and the size of the received PU to interpolate a sub-pel pixel value for use in a temporal prediction process for the PU.