Our findings also explain why referring to additional information-including dialog context [19] , keywords <cite>[3]</cite> and knowledge bases [20]-helps dialog systems: the number of plausible target sentences decreases if the generation is conditioned on more information; this intuition is helpful for future development of text-based response generation in Seq2Seq dialog systems.