Our hypothesis is that this is due to the fact that ELMo <cite>[33]</cite> is a deep representation composed by different levels that can capture superficial features such as sentence length as well as deep linguistic properties as seen in the challenging SOMO task.