Recent studies begin to research pitch and rhythm in VC such as SpeechSplit [1]}, SpeechSplit2.0 [2]} and MAP Network [3]}. They have provided a great start for the controllable synthesis of each representation.
Whereas, their performances can still be improved for one-shot VC.
A recent effort VQMIVC [4]} provides the pitch information to retain source intonation variations, resulting in high-quality one-shot VC.
However, it does not consider the decoupling of rhythm,
resulting in that pitch and rhythm still entangles together.
