The SELD evaluation metrics have evolved over the past three years. In DCASE 2019, SED and DOAE performances were evaluated independently. Segment-wise error rate (ER) and F1 score evaluation were used for SED [1]}, while frame-wise DOA error and frame recall were used for DOAE [2]}. Since 2020, SED and DOAE were evaluated jointly with location-dependent ER and F1 score for SED, and class-dependent localization error (LE) and localization recall (LR) for DOAE [3]}. The 2021 metrics further take into account overlapping same-class events [4]}.
