Our experiments indicate that neural systems are quite good at producing fluent outputs and generally score well on standard word-match metrics, but perform quite poorly at content selection and at capturing long-term structure.
Our experiments indicate that neural systems are quite good at capturing higher level semantics and structure but perform quite poorly at surface-level language modeling.