The detailed network archiecture for EfficientFormer-L1, EfficientFormer-L3, and EfficientFormer-L7 is provided in Tab. REF .
We report the resolution and number of blocks for each stage.
In addition, the width of EfficientFormer is specified as the embedding dimension (Embed. Dim.).
As for the MHSA block, the dimension of Query and Key is provided, and we employ eight heads for all EfficientFormer variants.
MLP expansion ratio is set as default (4), as in most ViT arts [1]}.
<TABLE>