In this paper, we conduct an extensive survey of existing research on X-of-thought reasoning, offering a comprehensive review of the field. We introduce the concept of generalized chain-of-thought (X-of-Thought) and examine advances in X-of-thought reasoning from various angles. Additionally, we investigate the applications of X-of-thought in cutting-edge domains. Furthermore, we spotlight the current challenges confronting this research and provide future prospects. To the best of our knowledge, this survey represents the first systematic exploration of chain-of-thought reasoning. Our objective is to furnish researchers interested in chain-of-thought reasoning with a thorough overview, with the hope that this survey will facilitate further research in this area.