In recent years, the development of large language models has revolutionized the field of natural language processing, however, the widely used Transformer architecture is limited by high computational and memory requirements. To address these issues, many researchers devoted themselves to simplifying the Transformers to achieve efficient computation and limited memory requirements. Among them, State Space Model is one of the most effective solutions we reviewed in this paper.