For example, neural encoderdecoder models, which are becoming the de facto standard for various natural language generation tasks including machine translation (Sutskever, Vinyals, and Le 2014) , summarization (Rush, Chopra, and Weston 2015) , dialogue <cite>(Wen et al. 2015)</cite> , and caption generation<cite> (Vinyals et al. 2015)</cite> can be interpreted as conditional neural language models.