Smith [162] is a novel spatiotemporal modeling approach focused on improving the efficiency and performance of modeling long sequence data. It combines the advantages of Convolutional Neural Networks (CNNs) and state space methods to effectively overcome the limitations of traditional models in dealing with complex spatial correlations and long time dependencies. ConvSSM significantly improves the speed of model training and prediction through parallel scanning and fast auto-regressive generation techniques. Meanwhile, it draws on state-space methods such as S4 and S5 to provide effective parameterization and initialization strategies for long-distance dependency modeling. This approach not only reduces the consumption of computational resources but also maintains a performance level comparable to that of complex models. Compared to other models, such as Transformer, whose computational cost grows significantly with sequence length, and ConvLSTM, which has a slower training speed, ConvSSM demonstrates its potential in long sequence spatiotemporal modeling. In addition, researchers are also exploring ways to further improve model performance by optimizing convolutional kernel design and combining the advantages of different models. [165] proposes an approach that fuses a hybrid Mixture of Expert (MoE) mechanism and a selective State Space Model (SSM) with the aim of optimising the efficiency and performance of sequence modeling. This approach introduces MoE on top of the Mampa model, achieving similar performance in fewer training steps and maintaining the inference performance advantage over the Transformer model. The MoE model utilizes dynamic gating, expert caching, and load balancing techniques to address the communication and memory issues faced by large models during the inference phase, while conditionally computing to extend the model without significantly increasing the computational cost while expanding the model capacity. It is shown that MoE models with instruction fine-tuning and task-specific fine-tuning are able to achieve better performance than denser models with the same computational complexity. The success of MoE-Mampa demonstrates that the performance and efficiency of sequence modeling tasks can be effectively improved by a well-designed MoE architecture, which opens up new possibilities for processing large-scale sequence data. Xu et al. [186] demonstrate the potential of Mampa models for classical information retrieval tasks by evaluating the performance of models based on the Mampa architecture in a document ranking task. Compared to Transformer-based language models, Mampa models achieve competitive performance in the same training configuration. However, the Mampa model falls short in terms of training throughput compared to efficient attention implementations, limiting its potential for efficient training and deployment. Although the study focuses on models with parameters less than 1B, they find that this may change when scaling to larger models and employing different training configurations. Thus, the effectiveness and performance of Mampa models in other classical information retrieval tasks remain to be further investigated. Amo et al. [193] introduce the SSM system and summarize the research progress in the field of control-theoretic. Sharma et al. [187] are inspired by the research found in the autoregressive transformer language model that knowledge recall can be specific to specific modules and marker positions, and aims to locate factual recall in Mampa. Olucha et al. proposed an overview of the state-of-the-art and comparative study of linear parameter-varying state-space (LPV-SS) model downscaling [194]. These comparisons can help to select the best downscaling method for a given LPV-SS model. Yang et al. propose the Rec-Mampa [190] model for sequence recommendation tasks. This model better models users' preference information that changes over time through the Mampa module, improving personalized recommendation performance and reducing computational complexity. Compared to SASRec, the training time is reduced by approximately \(70\%\). LaRocque et al. [183] compares the performance of Convolutional Neural Networks (CNNs) and the novel State Space Model (SSM)-based Mampa architecture, revealing intriguing insights into their respective strengths and the benefits of dataset fusion for improved terrain.