ECLAD: Extracting Concepts with Local Aggregated Descriptors
Convolutional neural networks are being increasingly used in critical
systems, where ensuring their robustness and alignment is crucial. In this
context, the field of explainable artificial intelligence has proposed the
generation of high-level explanations through concept extraction. These methods
detect whether a concept is present in an image, but are incapable of locating
where. What is more, a fair comparison of approaches is difficult, as proper
validation procedures are missing. To fill these gaps, we propose a novel
method for automatic concept extraction and localization based on
representations obtained through the pixel-wise aggregations of activation maps
of CNNs. Further, we introduce a process for the validation of
concept-extraction techniques based on synthetic datasets with pixel-wise
annotations of their main components, reducing human intervention. Through
extensive experimentation on both synthetic and real-world datasets, our method
achieves better performance in comparison to state-of-the-art alternatives.