We hypothesized that the mean-over-time layer is helpful when the input consists of longer responses (as was the case for the essay data in<cite> Taghipour and Ng (2016)</cite> ). We computed the Pearson's correlation on the ASAP-SAS data between the difference on each prompt of the two conditions and the mean response length in the development set. However, the correlation was modest at 0.437.