Due to the expert's high cost of building fonts, automatic font generation with deep learning has drawn rising attention. It aims at generating a brand new font library with only a few characters as a reference. With the development of Generative Adversarial Networks (GANs) [1]}, [2]}, there have been many classic works of font generation. Early attempts, such as zi2zi [3]}, use Pix2Pix [4]} like networks with a plug-in font category embedding conditions to learn multiple font styles with a single model. However, these methods require a large number of glyphs to train each unseen font.
