We evaluate three end-to-end NLG systems: RNNLG<cite> (Wen et al., 2015)</cite> , TGen (Dušek and Jurčíček, 2015) and LOLS (Lampouras and Vlachos, 2016) , using a large number of 21 automated metrics.