Numerous studies have extended the framework of chain-of-thought to various formats to enhance the capacity for planning further. Tree-of-Thought (Yao et al., 2023) enables LLMs to consider multiple reasoning paths in a tree and self-evaluate to determine the next course of action. In cases where global decisions are necessary, ToT allows forward or backward exploration through techniques like deep-first search or breadth-first search. Reasoning via Planning (RAP) (Hao et al., 2023) also divides the problem into a tree and explores them by Monto Carlo tree search algorithm, using LLMs as both world-model and reasoning agent. Another method, Graph of Thought (GoT) (Yao et al., 2023), employs graph nodes to represent individual thoughts and external Graph Neural Networks for organization. LLM+P (Liu et al., 2023) and LLM+DP (Dagan et al., 2023) facilitate the generation of Planning Domain Definition Language (PDDL) (Gerevini, 2020) by LLMs. PDDL assists in decomposing complex problems and utilizing specialized models for planning before converting the results into natural language for LLM processing. However, it is essential to note that these methods use tree/graph/PDDL nodes to represent thoughts, which have limitations regarding their representation forms and can only handle specific planning problems.