retical analysis and numerical verification, it is concluded that state-space models do not fundamentally address the issue of exponential decaying memory. Samsami et al. [169] propose a method named R2I to enhance long-term memory and long-term credit, which integrates a set of state-space models into the world model of model-based reinforcement learning (MBRL) agents, thereby solving the issue that existing MBRL agents were unable to deal with the long-term intervals between actions and outcomes. Experimental results demonstrated that R2I achieved state-of-the-art performance in memory and credit assignment RL tasks, while also exhibiting faster convergence speed. Black-Mamba [167] merging SSMs with mixture-of-experts (MoE) significantly reduces inference costs, paving the way for efficient and scalable text generation tasks. MambaByte [166] is a token-free selective State Space Model designed for learning directly from raw bytes and its recurrent nature enables fast text generation, highlighting its practicality for large-scale models and paving the way for future developments in token-free language modeling. Self pretraining (SPT) [192] challenges the conventional approach of comparing long-sequence models from scratch, revealing that pre-training with data-driven priors significantly alters performance evaluations. By leveraging pre-training, the research achieves substantial improvements across various architectures, closing the performance gap between Transformers and SSMs and even surpassing previous SSM results on tasks. Laughing Hyena Distillery [161] proposes Laughing Hyena, a new distillation method that extracts compact state-space models from pre-trained long convolutional sequence models without loss of quality, utilizes rational function approximation and model downscaling techniques to extract low-dimensional state-space models in the convolutional layers, and achieves automated regression generation with constant memory and constant time complexity. Improved Hyena improves pre-training quality and reduces the number of filters to be distilled by binding filter weights to heads across channels.