Result and analysis: Fig. 4 demonstrates the training curve of the baseline, ResNet-50-S3 and these three models, and TABLE REF  shows the accuracy result. The training accuracy of these five models is almost the same. The performance of ResNet-50-S3-SR surpasses the baseline and is the highest, the accuracy of ResNet-50-S3-D is the lowest, the accuracy of ResNet-50-S3 and ResNet-50-S3-S is second only to the baseline, and the performance of ResNet-50-S3-S exceeds that of ResNet-50-S3. In the early stage of training, the fitting stagnation phenomenon appears in ResNet-50-S3 and ResNet-50-S3-D. The fitting stagnation disappears in ResNet-50-S3-S and ResNet-50-S3-SR. At the same time, between the 40th and 60th epoch, the accuracy of ResNet-50-S3 fluctuates violently. This phenomenon does not exist in the other models but in CIFAR-10 [1]} training as shown in Section REF .
