Graph StructureCompared to trees, graphs introduce loops and rings, which bring more complex topological relationships and allow for modeling more complex reasoning, as shown in Figure 2(f). GoT (Besta et al., 2023; Lei et al., 2023) regards intermediate thought as nodes within a graph, combining exploration and backtracking operations, and additionally introduces aggregation and refinement operations compared to tree-of-thought. The additional operations, aggregation and refinement elicit better reasoning in complex tasks. Nevertheless, it faces the same dilemmas as the tree-of-thought, i.e., task limitations and poor generalizability. Besides, it has increased reasoning costs. Unlike GoT, which explicitly constructs a thought graph, ResPrompt Jiang et al. (2023) introduces residual connections between thoughts in the prompt text, allowing the reasoning of different steps to interact with each other.