Our experiments indicate that neural systems are quite good at surface-level language modeling, but perform quite poorly at capturing higher level semantics and structure.
Our experiments indicate that neural systems are quite good at producing fluent outputs and generally score well on standard word-match metrics, but perform quite poorly at content selection and at capturing long-term structure.