Our model architecture is illustrated in fig:2.
We adopt a transformer decoder architecture, which processes music conditioning projected to the transformer dimension with a cross-attention mechanism following Saharia et al. [1]}.
Timestep information is incorporated both with a token concatenated with the music conditioning and feature-wise linear modulation (FiLM) [2]}.
