ConEx Bridges Saliency Maps and Concept-Based Reasoning for Interpretable Vision

Yehonatan Elisha · hf · 2026-10-07

Researchers introduce ConEx (Concept-based Explanations), a framework linking pixel-level saliency visualization with concept-based reasoning so visual explanations are both faithful and interpretable.

ConEx automatically discovers class-specific concepts represented as concept activation vectors (CAVs), learned without manual supervision via an architecture-specific masking mechanism that reduces segmentation-mask noise. Its saliency maps reveal where each concept appears and how it contributes to the prediction. Two complementary metrics, Vector-Concept Match (VCM) and Concept-Class Match (CCM), quantify concept alignment and enable comparison with prior methods.

Experiments show state-of-the-art performance on faithfulness, segmentation, and concept-quality benchmarks.

Original post →

More from Research

Research channel →