HOME Board
Notice

Notice

Hit 395
Subject [BMVC 2021] M-CAM: Visual Explanation of Challenging Conditioned Dataset with Bias-reducing Memory (by Seongyeop Kim) is accepted in BMVC 2021
Name IVY Lab. KAIST
Date 2021-10-20
Title: M-CAM: Visual Explanation of Challenging Conditioned Dataset with Bias-reducing Memory

Authors: Seongyeop Kim and Yong Man Ro

We introduce a framework that enhances visual explanation of class activation map (CAM) with key-value memory structure for deep networks. We reveal challenging conditions inherently existing in several datasets that degrade the visual explanation quality of existing CAM-based visual explanation methods (e.g. imbalanced data, multi-object co-occurrence) and try to solve it with the proposed framework. The proposed Bias-reducing memory module learns spatial feature representation of different classes from trained networks and stores each different semantic information in separate memory slots, while it does not require any modification to the existing networks. Furthermore, we propose a novel visual explanation method accompanied by a memory slot searching algorithm to retrieve semantically relevant spatial feature representation from the memory module and make visual explanation of network decisions. We evaluate our visual explanation framework with datasets of challenging conditions including several medical image datasets and multiclass classification datasets. We qualitatively and quantitatively compare it with existing CAM-based methods to demonstrate the strength of our framework.


IMAGE VIDEO SYSTEM (IVY.) KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY (KAIST), BMVC 2021