Large-kernel convolutions are not well supported by most compilers and cannot be accelerated through existing algorithms like Winograd [1]}.
Alternatively, the non-overlapping patch embedding can be replaced by a convolution stem with fast downsampling [2]}, [3]}, [4]} that consists of several hardware-efficient \(3\times 3\)  convolutions (Fig. REF ).
<FIGURE>