With more uncertainty associated with rare
classes, it is reasonable to pull their embeddings together more strongly than those from frequent classes.
This implicitly ensures that embeddings
of rare classes are well-separated from other classes and helps accommodate embeddings of unobserved instances during test time, which may have high variance.
In line with these, we thus propose setting \(\alpha _y \propto \mathbb {P}(y)^{a}\)  where \(a > 0\) .
In the sequel, we shall focus on \(a=1\)  or \(a = \frac{1}{2}\) .
A similar consideration was made by Samuel and Chechik [1]},
as shall be detailed in §REF .
