Most importantly, we are able to reach those results while being two orders of magnitude faster at training time: <cite>Sperber et al. (2017)</cite> report taking 1.5 days for each epoch while our architecture can process each epoch in 15min.