Another direction of explanation is to check the black box model by modifying the input and observing the response in the prediction. A representative method [1]} aims to optimize the blurred region and see which region has the strongest response on the output signal when it is blurred. Perturbation optimization is applicable for any black box model, but the optimization is computationally expensive.
<FIGURE>