Our base architecture is the Deepmoji model <cite>(Felbo et al., 2017)</cite> , which is based on two stacked word-based bi-directional LSTM recurrent neural networks with skip connections between the first and the second LSTM.