We created the spoken STAIR dataset so it would follow the exact same train/val/test 5 split as<cite> [4]</cite> . We thus have two comparable corpora: one featuring images and spoken captions in English, and another one featuring the same images and spoken captions in Japanese. This allowed us to compare the behaviour of the same architecture on two typologically different languages.