Thus, we cannot directly access the information on the internal working of a complex model. Yet it is possible to observe the effects of this working, namely, the predictions done by those models. We can consider each prediction made by a model as an additional clue on the way the model functions internally. That the approach is used by a large part of the literature to understand how a model works [1]}, [2]}. In those approaches, two main goals can be seen: explaining the model behavior globally, in order to understand it in the general context, or explaining the model behavior for a particular prediction, aiming to highlight that particular decision process.
