1. A method of decoding video data, the method comprising: determining, by one or more processors, a first co-located reference picture in a first layer for generating a first temporal motion vector predictor candidate for predicting a motion vector of a current block of a current picture of the first layer; determining, by the one or more processors, a second co-located reference picture in a second layer of video data that is different from the first layer for generating a second temporal motion vector predictor candidate for predicting the motion vector of the current block of the current picture of the first layer; determining, by the one or more processors, a motion vector predictor candidate list that includes at least one of the first temporal motion vector predictor candidate and the second temporal motion vector predictor candidate; selecting, by the one or more processors, a motion vector predictor from the motion vector predictor candidate list; and decoding, by the one or more processors, the motion vector of the current block relative to the selected motion vector predictor.