Recently, the augmentation of neural networks with external memory components has been shown to be a powerful means of capturing context of different types (Graves et al., 2014 Rae et al., 2016) . Of particular interest to this work is the work by<cite> Sukhbaatar et al. (2015)</cite> , on end-toend memory networks (N2Ns), which exhibit remarkable reasoning capabilities, e.g. for reasoning and goal-oriented dialogue tasks .