Our main experimental finding is that despite significant differences between SL and RL agents reported in previous work<cite> (Das et al. 2017b)</cite> , we find no significant difference in performance between ALICE SL or ALICE RL when paired with human partners (Sec. 6.1).