NEFtune: Adding random noise to the token embedding vectors. Its experiments show that a small scale of noise can enhance the capability of LLM conversation and improve Alpaca-eval scores Jain et al. (2023). In its original setup, noise is added to all input embeddings, including both source and target.