**Text Generation.** Text generation tasks, _e.g._, machine translation [624] and automatic summarization [548], are long-standing NLP tasks that have been widely studied, and there have been a number of deployed products and systems based on fine-tuned small models [764, 311]. Since the pre-training of LLMs is established on text prediction, they exhibit strong language generation abilities as commercial products [627] and humans [628], with the help of proper prompts [765, 766]. Additionally, LLMs are flexible to effectively handle special requirement in real-world application scenarios, _e.g._, document-level translation [767], and also enable natural language interaction with users to further improve the generation quality [768]. Despite the above success, recent work also reveals that LLMs are hard to well address the generation tasks about low-resource languages and domains, _e.g._, Marathi-to-English translation [769], due to their unbalanced training data across different languages.