In the OOD literature, the OOD detection performance is typically reported using the threshold independent area under the receiver operating curve (AUC) on an OOD data set [1]}, [2]}, [3]}.
However, without specifying a threshold and reporting the OOD performance on a held-out test data set, the reported results do not answer how these methods would perform in a real-world scenario.
Similar to Lee et al. we pick the OOD threshold at an ID classification sensitivity of 95 % [4]}.
In contrast to previous works, we do so on the validation set (CXR14 + OOD) and report the performance on the test set.
This allows us to measure the chest X-ray classification performance in a more realistic scenario: after removing predicted OOD samples on the test set, as shown in Figure REF  c .
