We narrow the comparison to the two token mixers, pooling and MHSA, where we choose the former for its simplicity and efficiency, while the latter for better performance.
More complicated token mixers like shifted window [1]} are currently not supported by most public mobile compilers and we leave them outside our scope.
Furthermore, we do not use depth-wise convolution to replace pooling [2]} as we focus on building architecture without the aid of lightweight convolutions.
