In recent years, an increasing number of studies have investigated character-level models with subwords in both unsupervised<cite> (Bojanowski et al., 2017</cite>; Pagliardini et al., 2018) and supervised learning (Zhang et al., 2015; Sennrich et al., 2016; Wieting et al., 2016; Lee et al., 2017) .