While SPENs have been used for multiple NLP tasks, including multi-label classification (Belanger and McCallum, 2016) , part-of-speech tagging <cite>(Tu and Gimpel, 2018)</cite> , and semantic role labeling (Belanger et al., 2017) , they are not widely used in NLP.