Apart from relying on ECE and Brier score, incorporating metrics like AUROC, AUPR etc. helps in further distinguishing useful calibration approaches. Utilizing such measures can help researchers to make an intelligent and well-formed decision regarding the suitability of an approach for their application. Additionally, many evaluation protocols have been proposed recently which extend the problem of calibration to a multi-class setting [1]}. A natural extension will be to study refinement conjointly with calibration in a similar manner.
