In previous work we showed that the RL-based policy significantly outperforms the supervised policy in terms of improved user ratings and dialogue performance measures<cite> (Rieser and Lemon, 2008b)</cite> .