We implement EfficientFormer through PyTorch 1.11 [1]} and Timm library [2]}, which is the common practice in recent arts [3]}, [4]}.
Our models are trained on a cluster with NVIDIA A100 and V100 GPUs.
The mobile speed is averaged over \(1,000\)  runs on iPhone 12 equipped with an A14 bionic chip, with all available computing resources (NPU).
CoreMLTools is used to deploy the run-time model. We provide detailed network architecture and more ablations in Appendix.
