I use the stimuli provided by (<cite>Linzen et al., 2016</cite>; Gulordava et al., 2018; Marvin and Linzen, 2018) , but change the experimental protocol to adapt it to the bidirectional nature of the BERT model.