1. A method of decoding video data, the method comprising: determining a first palette predictor list that comprises one or more candidates, each respective candidate in the first palette predictor list specifying a respective palette entry in a palette for a previously-coded block of the video data; determining a second palette predictor list comprising one or more additional candidates, each respective additional candidate in the second palette predictor list specifying a pixel value of a different respective reconstructed neighboring pixel from among one or more reconstructed neighboring pixels, wherein each of the one or more reconstructed neighboring pixels is in a line above or a column left of a current block of the video data, wherein the one or more additional candidates in the second palette predictor list are in addition to the one or more candidates in the first palette predictor list; determining, based on a metric of similarity of a first candidate in the first palette predictor list and a second candidate in the second palette predictor list, whether to remove the second candidate from the second palette predictor list; removing the second candidate from the second palette predictor list responsive to the determination; obtaining, from a bitstream, a binary vector comprising one or more binary vector syntax elements, wherein each of the one or more binary vector syntax elements corresponds to a different candidate of the one or more additional candidates in the second palette predictor list; after removing the second candidate from the second palette predictor list: for each respective candidate in the second palette predictor list, determining, based on the binary vector syntax element corresponding to the respective candidate in the second palette predictor list, whether the respective candidate in the second palette predictor list is included in a palette for the current block; and including, in the palette for the current block, at least one candidate from the first palette predictor list and at least one candidate from the second palette predictor list, each palette entry in the palette for the current block specifying a respective pixel value; obtaining, based on one or more additional syntax elements signaled in the bitstream, an index value for a pixel of the current block; identifying a palette entry in the palette that corresponds to the index value for the pixel; and determining, based on the pixel value specified by the identified palette entry, at least one reconstructed sample value of the pixel.