With the growing prevalence of convolutional neural networks (CNNs), there is an urgent demand to explain their behaviors. Global explanations contribute to understanding model predictions on a whole category of samples, and thus have attracted increasing interest recently. However, existing methods overwhelmingly conduct separate input attribution or rely on local approximations of models, making them fail to offer faithful global explanations of CNNs. To overcome such drawbacks, we propose a novel two-stage framework, Attacking for Interpretability (AfI), which explains model decisions in terms of the importance of user-defined concepts. AfI first conducts a feature occlusion analysis, which resembles a process of attacking models to derive the category-wide importance of different features. We then map the feature importance to concept importance through ad-hoc semantic tasks. Experimental results confirm the effectiveness of AfI and its superiority in providing more accurate estimations of concept importance than existing proposals.
Housam Khalifa Bashier BabikerMiyoung KimRandy Goebel
Elisa NguyenMeike NautaGwenn EnglebienneChristin Seifert
Andreas WaldisLuca MazzolaM. Kaufmann
Waldis, Andreas (Autor/in)Mazzola, Luca (Autor/in)Kaufmann, Michael (Autor/in)
Mark IbrahimMelissa LouieCeena ModarresJohn Paisley