The work described in this paper uses probabilistic latent variable models to describe patterns of syntactic interaction, building on the selectional preference models ofÓ Séaghdha (2010) and Ritter et al. (2010) and the lexical substitution models of<cite> Dinu and Lapata (2010)</cite> . We propose novel methods for incorporating information about syntactic context in models of lexical choice, yielding a probabilistic analogue to dependency-based models of contextual similarity.