( We use the term prosody as defined in earlier work<cite> [4]</cite> henceforth.) Because there is no available label for prosody, learning to control prosody in TTS is a difficult problem to tackle.