We propose here to extend the LRP application to a linguistically motivated network architecture, known as <cite>Kernel-Based Deep Architecture</cite> (<cite>KDA</cite>) <cite>[5]</cite> , which frames semantic information captured by linguistic Tree Kernel [2] methods within the neural-based learning paradigm.