CIFAR-10 [1]}, CIFAR-100 [1]}, Fashion-MNIST [3]} and MNIST [4]} datasets are used for experiments. CIFAR-10 and CIFAR-100 both have 50,000 training and testing images; CIFAR-10 and CIFAR-100 have 10 and 100 classes, respectively. Fashion-MNIST and MNIST datasets both have 60,000 and 10,000 training and testing images, respectively. In addition, both datasets have 10 different classes. We observe that similar datasets have been used in [5]}, [6]} for studying the generalization gap problem.
