Knowledge Enhancement. The second category of work involved prior knowledge. Kim et al. DBLP:conf/cvpr/0003COK19 proposed a relationship-based captioning model that considered part-of-speech (POS, i.e. subject-object-predicate categories) tags of captions, and therefore introduced beneficial inductive bias. Shi et al. further explored the semantics conveyed in the subject-object-predicate triples to enhance image caption generation [1]}. The subject-object-predicate triples are extracted from captions by a textual scene graph parser introduced in [2]}.
