Both [17] and <cite>[3]</cite> use time-consuming instruction text preprocessing over the skip-thought technique [15] . This process doubles the overall training time from three days to six days using two Nvidia Titan X GPU's. By using online-instruction encoding with the self-attention encoder, we were able train the model for its main task in under 30 hours.