For our control networks, we implemented ResNet 20, ResNet 32, ResNet 44, ResNet 56, and ResNet 110 based on Facebook's models [1]}. We considered two regularization techniques, mixup and cutout, and trained ten different types of networks with regularization: either mixup or cutout applied on each of the five control models [2]}, [3]}. For pruning, we harnessed soft filter pruning [4]}. Each of the five control models then had pruning added. Lastly, we constructed our fourth class of networks by combining soft filter pruning and each of mixup and cutout to each of the control models.
