1. A method comprising: processing an input video sequence to determine a motion vector at a first level of accuracy; refining the motion vector at a second level of accuracy; selecting a subset including less than all of candidate pixel locations based on a relationship between corresponding best candidate pixel locations of the first and second levels of accuracy; and determining the motion vector at a third level of accuracy using only the subset of candidate pixel locations.