Inspired by the use of attention in sequence-to-sequence learning for machine translation [16,<cite> 18]</cite> , visual attention has been proved to be a very effective way of improving image captioning.