Visual and Dialogue Processing. We encode video frames with a Convolutional Neural Network and encode dialogue utterances with bert-large-uncased [1]}. As dialogue exchanges are a sparse input, a zero-vector is used when there is no associated dialogue utterance at a particular time point.
