We build off a state-of-the-art attentive LSTM model from prior work<cite> (Eshel et al., 2017)</cite> and show that despite its good performance, it fails to resolve some examples that human readers would find trivial.