With the emergence of the Mamba [12], the SSM model is increasingly attracting attention and favor from current researchers. The following works are currently explored in language modeling task [41][45][46][47][48], deep noise suppression task [42], and clinical note understanding task [49]. To be specific, for the language modeling task, [41] mainly studies the application of gated state spaces in the direction of long-range language modeling and introduces a novel method called GSS (Gated State Space). It can be used on long sequence modeling and effectively reduce the number of participants. Their experiments demonstrate that it achieves 2-3 times faster than the DSS [38]. Grazzi et al. [45] exploit the Mamba on simple function estimation and natural language processing in context learning tasks and validate that the overall performance is indeed better than the S4 version and comparable to other Transformer networks. S4++ [46] finds two issues of S4 architecture, i.e., the non-stationary state (NSS) and dependency bias, and proposes the State Memory Reply (SMR) mechanism to integrate multi-state information into the current state. They also integrate complex dependency bias via an interactive cross-attention mechanism and extensive experimental results show that S4++ outperforms S4 on multiple sequence modeling tasks, demonstrating significant performance gains.