Furthermore, the visual attention mechanism is embedded into the visual captioning spectrum. During the sentence generation, the visual attention module is able to adaptively locate the most salient areas in the image given the current hidden states for more accurate prediction. Different structures are proposed such as soft attention [1]}, adaptive attention [2]}, depth attention [3]}, top-down and bottom-up attention [4]}, etc.
