**Information Extraction.** The information extraction task focuses on automatically extracting useful structured information from unstructured text data, such as relation extraction [759] and event extraction [760], which is also a crucial task relating to many NLP applications. Typically, previous studies formulate this task as a text classification task or a sequential labeling task. As information extraction often needs to accurately understand and process complex semantic relations (multiple relations within one sentence), in-context learning with LLMs typically underperform state-of-the-art full-data fine-tuning methods [761, 762]. Whereas, it is shown that enabling collaboration between LLMs and small models can further boost the performance of specific tasks [763, 762]. In addition, a recent study [425] also reveals that LLMs can achieve competitive zero-shot performance for information extraction with a two-stage workflow, making this approach attractive in future applications.