We evaluate model performance of clients on 5 image datasets: FMNIST [1]}, CIFAR10 [2]}, Digit5 [3]}, Office-Caltech10 [4]}, and DomainNet [3]}. Figure REF  shows some samples of the 5 datasets. FMNIST and CIFAR10 simulate the independent identically distributed (IID) setting. Digit5, Office-Caltech10, and DomainNet comprise data from multiple domains, and thus they naturally form the Non-IID setting. DomainNet has images across 345 categories, from which we pick the top 10 categories with the most samples for experiments. To keep the image resolution consistent across all experiments, we resize all images in all datasets to 32 \(\times \)  32.
