We also investigated if we could improve the performance of M2A by using SOTA attention blocks. Table REF  shows the results of M2A using M2A's attention block (M2A-Attention), space and time based attention block (S+T Patch with a patch of size \(s \times s\) ) from [1]}, and TAM attention [2]}. We found that M2A's attention performed the best; and that there wasn't a significant performance difference across the other SOTA attention blocks.
<TABLE><FIGURE>