Although incredibly simple in formulation and training, many recent works have demonstrated certain flaws in CBMs which warrant an increased caution in their widespread applications. For exmaple, Margeloiu et al. [1]} demonstrated that computing the saliency maps with respect to a single concept does not capture the position of that concept in the image itself. Similarly, Mahinpei et al. [2]} demonstrate that CBMs suffer from “information leakage” where more than necessary information is encoded in a concept - making them adulterated with non-relevant noise resulting in unreliable downward predictions.
