speed up training efficiency while ensuring performance. The authors use local attention to extract local information, and then use the state-space model to extract the global information missing from local attention. [48] argues that existing State Space Models, while efficient, lack in performance. The authors believe the reason for this is that too many state transitions make the model lose shallow information. So the authors propose a design that integrates the hidden states in the previous layers into the subsequent layers to retain more shallow information. Eventually, after pre-training on Pile, the experimental results of Zero-shot and four-shot on other datasets are significantly improved. For voice tasks, Du et al. [42] combine the high efficiency of impulse neural networks and the ability to model long distances with the state-space model S4 to obtain an spiking neural network, which has a low number of parameters but comparable performance to that of some artificial neural network (ANN) in deep noise suppression task. In addition, for speech separation task, DPMamba [43] proposed by Jiang et al. uses the selective State Space Model Mamba to replace the traditional transformer architecture. DPMamba simultaneously models the short-term and long-term forward and backward dependencies of speech signals through selective state space, achieving comparable results to the dual-path Transformer model Sepformer [134]. SPAMba [44] proposed by Li et al. uses TF-GridNet [135] as the basic framework and replaces the Transformer module with a bidirectional Mamba module to capture a wider range of language information. Experimental results show that Mamba-based models play an important role in performance.