1. A method of encoding a motion vector in a video encoding process comprising: determining one of a plurality of modes for a motion vector prediction process for a current block of video data to be encoded, wherein the plurality of modes includes a merge mode and an adaptive motion vector prediction mode; and performing the motion vector prediction process for the current block of video data using the determined mode and a set of candidate blocks, wherein the set of candidate blocks is the same for each of the plurality of modes, and wherein the set of candidate blocks includes a left above candidate block, an above candidate block, a right above candidate block, a left candidate block, a below left candidate block, and a temporal candidate block.