On the other hand, we can impose limited architectural constraints in the form of selective rationalization<cite> (Lei et al., 2016</cite>; Li et al., 2016b; Chen et al., 2018a,b) where the goal is to only expose the portion of the text relevant for prediction. In this paper, we build on and extend selective rationalization.