\(\bullet\)_Tree-structured reasoning._ This approach (exemplified by Tree of Thoughts (ToT) [451, 515]) formulates the reasoning process in a hierarchical tree structure, where intermediate thoughts are nodes. In this way, it enables LLMs to explore multiple reasoning paths in parallel and further supports the operation of lookahead and backtracking to facilitate more comprehensive decisions. In addition, TouT [516] takes the uncertainty of intermediate thoughts into account for thought evaluation based on Monte Carlo Dropout.