In this section, we provide extra experimental results with extensive hyper-parameter settings.
We commonly use 128 clients and a lcoal batch size of 32 in all the experiments.
The gradual learning rate warmup ([1]}) is also applied to the first 10 epochs in all the experiments.
