In this work, we propose a novel framework named Coconditional Autoencoding Adversarial Networks (CocoAAN) for Chinese font learning, which jointly learns a generation network and two encoding networks of different feature domains using an adversarial process. The encoding networks map the glyph images into style and content features respectively via the pairwise substitution optimization strategy, and the generation network maps these two kinds of features to glyph samples. Together with a discriminative network conditioned on the extracted features, our framework succeeds in producing realistic-looking Chinese glyph images flexibly. Unlike previous models relying on the complex segmentation of Chinese components or strokes, our model can "parse" structures in an unsupervised way, through which the content feature representation of each character is captured. Experiments demonstrate our framework has a powerful generalization capacity to other unseen fonts and characters.
zi2zi https: github.com kaonashi-tyc zi2zi and other relevant methods @cite_6 @cite_8 implements the Chinese characters’ style transfer based on pix2pix @cite_17 , which considers the generation as a problem of mapping from the source domain to the target pairwisely. Theoretically, different glyphs of a same font do share the same writing style, there should be a fixed mapping for any glyphs of two uniformly designed fonts. However, this kind of methods only concentrate on the mapping relationship in a specified font pair, while ignoring a lot more font resouces which would also lead to a lack of flexibility for new style learning, as for every new font pair, the netwroks must be retrained from scratch.
@cite_17 @cite_6 @cite_8
2047782836 2785648555 2739007166 2775226934
The existing method of contour-based font description is difficult to meet the personalized need for various style font generations because of the large size of Chinese character set. In this paper, we propose a novel glyph description method which treats the Chinese character as a constitution of the stable part called "structure" and the mutable part called "style". The structures of all characters are clustered by an improved K-Medoids method to guide the following generation of sample set which covers all kinds of style information of the whole character set. The result of cluster procedure indicates that radicals are bottlenecks for the reduction of sample set due to the low repetition rate in all characters. To address this problem, we present the radicals as a set of stroke-to-stroke layout structures, and render them from these substructures available in the sample set. Experiment results shows that the substitution enables us to learn the style information from a small set of sample characters (less than 10 of total amount) and generate the rest with the similar writing style. Traditional methods in Chinese typography synthesis view characters as an assembly of radicals and strokes, but they rely on manual definition of the key points, which is still time-costing. Some recent work on computer vision proposes a brand new approach: to treat every Chinese character as an independent and inseparable image, so the pre-processing and post-processing of each character can be avoided. Then with a combination of a transfer network and a discriminating network, one typography can be well transferred to another. Despite the quite satisfying performance of the model, the training process requires to be supervised, which means in the training data each character in the source domain and the target domain needs to be perfectly paired. Sometimes the pairing is time-costing, and sometimes there is no perfect pairing, such as the pairing between traditional Chinese and simplified Chinese characters. In this paper, we proposed an unsupervised typography transfer method which doesn't need pairing. In this paper, we propose a new network architecture for Chinese typography transformation based on deep learning. The architecture consists of two sub-networks: (1)a fully convolutional network(FCN) aiming at transferring specified typography style to another in condition of preserving structure information; (2)an adversarial network aiming at generating more realistic strokes in some details. Unlike models proposed before 2012 relying on the complex segmentation of Chinese components or strokes, our model treats every Chinese character as an inseparable image, so pre-processing or post-preprocessing are abandoned. Besides, our model adopts end-to-end training without pre-trained used in other deep models. The experiments demonstrates that our model can synthesize realistic-looking target typography from any source typography both on printed style and handwriting style. Building a complete personalized Chinese font library for an ordinary person is a tough task due to the existence of huge amounts of characters with complicated structures. Yet, existing automatic font generation methods still have many drawbacks. To address the problem, this paper proposes an end-to-end learning system, DCFont, to automatically generate the whole GB2312 font library that consists of 6763 Chinese characters from a small number (e.g., 775) of characters written by the user. Our system has two major advantages. On the one hand, the system works in an end-to-end manner, which means that human interventions during offline training and online generating periods are not required. On the other hand, a novel deep neural network architecture is designed to solve the font feature reconstruction and handwriting synthesis problems through adversarial training, which requires fewer input data but obtains more realistic and high-quality synthesis results compared to other deep learning based approaches. Experimental results verify the superiority of our method against the state of the art.