Our TBVE model uses the same encoder, variance adaptor, and decoder architectures as Fastspeech 2 [1]}. The encoder and decoders all consist of 4 feed-forward transformer blocks which transform the input features into a hidden sequence. The variance adaptor, which predicts variance information (durations, \(f_0\) ) for each phone timestep, consists of 2 one-dimensional convolutional layers with ReLU activations each followed by layer normalisation and dropout.
