Another example of a cyclical loss function is possible by making the softmax temperature [1]} dynamic — letting the temperature vary over the course of the training. We call this method cyclical softmax temperature (CST).
