1. A method performed by an information handling system for encoding a video sequence, the method comprising: identifying a prediction unit within a picture of the video sequence, wherein the prediction unit is bordered by neighboring prediction units within the picture, and wherein a best match for the prediction unit is located within a different first reference picture; scanning at least a subset of the neighboring prediction units to select a motion vector predictor (“MVP”) candidate, wherein the scanning includes: selecting a first type of the MVP candidate if available to be the selected MVP candidate, wherein the first type of the MVP candidate is defined as having a best match located within the first reference picture; and, in response to the first type of the MVP candidate being unavailable, selecting a second type of the MVP candidate to be the selected MVP candidate, wherein the second type of the MVP candidate is defined as having a best match located within a different second reference picture; calculating a difference between: a motion vector of the selected MVP candidate; and a motion vector of the prediction unit; and encoding the difference and an index to identify the selected MVP candidate.