Multimodal-CoT Zhang et al. (2023) firstly fine-tunes multi-modal models to generate chain-of-thoughts and then reasons over the rationales to obtain final answers. However, it suffers from the limitation of the linearity of the reasoning process and has difficulties in interacting between different modalities. To alleviate the challenges encountered by Multimodal-CoT, Yao et al. (2023) proposes Graph-of-Thought (GoT), which models the thought processes as a graph. It parses the reasoning chains into a thought graph, which enables a more realistic representation of thought processes by capturing non-sequential information interactions. This measure breaks the limitations of linear structure through graphical structures and further improves performance. Furthermore, Yao et al. (2023) proposes Hypergraph-of-Thought (HoT), replacing thought graphs with hypergraphs, which enables models with better ability of high-order multi-hop reasoning and multi-modal comparative judgment. Meanwhile, some work takes an approach based on knowledge distillation. T-SciQ Wang et al. (2023) generates high-quality CoT rationales from LLMs as fine-tuning signals and introduces a novel data mixing strategy to produce effective samples for different questions.