Recently, researchers have also explored other sampling strategies for LLMs. For instance, \(\eta\)_-sampling_[315] further improves top-\(p\) sampling by introducing a dynamic threshold based on the probability distribution. Furthermore, _contrastive search_[316] and _typical sampling_[317] can be utilized to improve the generation coherence during decoding. Since it has been found that large models tend to assign higher probability to important tokens compared to small models, _contrastive decoding_[318] utilizes a larger LM (_e.g._, OPT-13B) and a smaller LM (_e.g._, OPT-125M) to measure their log-likelihood differences. Subsequently, tokens are sampled based on the delta value of the probability distribution, thereby amplifying the impact of important tokens. Based on this contrastive idea, DoLa [319] further extends this approach to contrasting the logits across different layers of a single LLM, as higher layers tend to assign more weight to important tokens.