Since AWD-LSTM-MoS<cite> (Yang et al. 2018</cite> ) and AWD-LSTM-DOC<cite> (Takase, Suzuki, and Nagata 2018)</cite> achieved the stateof-the-art scores on PTB and WT2, we combined char3-MSvec with them.