Unimodal Contextualized Embedding. The local feature embeddings capture short-term dynamics but lack long-term contextual information. We use Transformers [1]} to enrich the embeddings with sequence-level context. We start by learning unimodal contextualized representations using the visual Transformer \(g_{V}\)  and the audio Transformer \(g_{A}\) , respectively.
