1. A method performed by an information handling system for encoding a video sequence, the method comprising: identifying a prediction unit within a picture of the video sequence, wherein the prediction unit is bordered by neighboring prediction units within the picture, and wherein a match for the prediction unit is located within a first reference picture; scanning at least a subset of the neighboring prediction units to identify a motion vector predictor (“MVP”) candidate, wherein the scanning includes: identifying a first type of the MVP candidate if available, wherein a match for the first type of the MVP candidate is located within the first reference picture; and, in response to the first type of the MVP candidate being unavailable, identifying a second type of the MVP candidate, wherein a match for the second type of the MVP candidate is located within a second reference picture; calculating a difference between: a motion vector of the MVP candidate; and a motion vector of the prediction unit; and encoding the difference and an index to identify the MVP candidate.