Figure REF  showcases the test accuracies on the imbalanced SVHN dataset for \(\epsilon =5,8\) . We experiment with these two \(\epsilon \)  values as demonstrated in the [1]} paper. We observe that both DP-SGD and PATE produce similar results with the averaged accuracies for the imbalanced class being \(< 5\%\) . However, it is important to note that PATE gives rise to robust results while DP-SGD exhibits higher standard deviations over different values of \(\epsilon \)  (refer Fig. REF , REF , REF , REF ). This property can again be referred to how the “students” learn different patterns on the disjoint data present within “teachers”.
