Despite the excellent capacities, LLMs often suffer from challenges on knowledge-intensive tasks, such as the potential to generate hallucinated content [602] and the lack of domain-specific knowledge [861]. As a promising solution, knowledge graphs (KGs), which store enormous knowledge in the triple format, _i.e.,_ (_head_entity, relation, tail_entity_ ), can be utilized to enhance the task performance of LLMs by providing precise and necessary knowledge. Generally, knowledge enhanced approaches can be expanded into other forms of structured data (_e.g.,_ tables and databases) [862], while we limit our discussion to the integration of KG for improving LLMs, which are detailed in two aspects, namely retrieval-augmented LLM and synergy-augmented LLM.