Tree StructureThe original chain structure inherently limits the scope of exploration. Through the incorporation of tree structures and tree search algorithms, models gain the capability to efficiently explore and backtrack during the reasoning process (Long, 2023; Yao et al., 2023), as shown in Figure 2(e). Combined with self-assessment of intermediate thoughts, models can achieve global optimum solutions. The reasoning process of ToT involves uncertainty, which can potentially lead to cascading errors. TouT (Mo and Xin, 2023) introduces Monte Carlo Dropout in reasoning, taking into account the uncertainty. Yu et al. (2023) delves into analogous problems, harnessing their solutions to elevate the intricate reasoning abilities of LLMs. These analogous problems exhibit a tree-like structure, ultimately converging to solve the main problem. However, the current tree-of-thought has considerable limitations on task selection and requires specific prompt designing for each task, which hinders its widespread application. SoT (Ning et al., 2023) is another variant of the tree structure, which decomposes a problem into subproblems that can be processed in parallel and solved simultaneously to speed up reasoning. However, its utility is restricted to parallel decomposable problems and is not suited for complex reasoning tasks.