Our perplexity results are shown in Table 1 , where we get significantly lower perplexities than the best single model from<cite> Chelba et al. (2013)</cite> , while having almost 6 times fewer parameters.