Similar to RNNs, SSM also suffers from the vanishing/exploding gradients problem when modeling longer sequences. To tackle this issue, HiPPO [36] model combines the concepts of Recurrent Memory and Optimal Polynomial Projections, which can significantly improve the performance of recursive memory, This mechanism is very helpful for SSM to handle long sequences and long-term dependencies.