Abstract There are two types of information in each handwritten word image: explicit information which can be easily read or derived directly, such as lexical content or word length, and implicit attributes such as the author’s identity. Whether features learned by a neural network for one task can be used for another task remains an open question. In this paper, we present a deep adaptive learning method for writer identification based on single-word images using multi-task learning. An auxiliary task is added to the training process to enforce the emergence of reusable features. Our proposed method transfers the benefits of the learned features of a convolutional neural network from an auxiliary task such as explicit content recognition to the main task of writer identification in a single procedure. Specifically, we propose a new adaptive convolutional layer to exploit the learned deep features. A multi-task neural network with one or several adaptive convolutional layers is trained end-to-end, to exploit robust generic features for a specific main task, i.e., writer identification. Three auxiliary tasks, corresponding to three explicit attributes of handwritten word images (lexical content, word length and character attributes), are evaluated. Experimental results on two benchmark datasets show that the proposed deep adaptive learning method can improve the performance of writer identification based on single-word images, compared to non-adaptive and simple linear-adaptive approaches.
Textural-based methods extract statistical information from the entire text blocks as features. Considering the handwritten text as a texture, textural features are extracted to measure the similarity blue in handwriting style between different handwritten document images. Local binary patterns (LBP) @cite_53 @cite_22 and local phase quantization (LPQ) are proposed in @cite_53 and the run-length of LBP is proposed in @cite_2 for writer identification. A run-length histogram blue with four principal directions is proposed in @cite_18 for writer identification in a multi-script environment. Filter-based features, such as Gabor @cite_45 , XGabor @cite_1 and oriented Basic Image Feature Columns (oBIF Columns) @cite_42 , blue have also been studied . Some features blue can be extracted from the contours of the ink trace, such as Hinge-based features @cite_36 @cite_37 @cite_24 @cite_47 , which extract the slant property of characters blue alongside other information, such as stroke width @cite_37 and curvature information @cite_52 . Other features, such as symbolic representation @cite_29 and k-adjacent segments (kAS) @cite_59 @cite_30 are also used for writer identification. Gaussian Mixture Models (GMMs) blue are used to model a blue person's handwriting in @cite_25 and Hidden Markov Model (HMM)-based recognizers are used in @cite_16 .
@cite_30 @cite_18 @cite_37 @cite_22 @cite_36 @cite_53 @cite_42 @cite_1 @cite_52 @cite_29 @cite_24 @cite_45 @cite_59 @cite_2 @cite_47 @cite_16 @cite_25
2130478883 2119305530 2574589360 2090985198
Highlights? A segmentation free process for writer identification verification. ? Evaluation of two texture descriptors (LBP and LPQ) for writer identification verification. ? Evaluation of the dissimilarity-based approach for writer identification. ? Discussion about the number and size of the references for the dissimilarity-based approach. In this work, we discuss the use of texture descriptors to perform writer verification and identification. We use a classification scheme based on dissimilarity representation, which has been successfully applied to verification problems. Besides assessing two texture descriptors (local binary patterns and local phase quantization), we also address important issues related to the dissimilarity representation, such as the impact of the number of references used for verification and identification, how the framework performs on the problem of writer identification, and how the dissimilarity-based approach compares to other feature-based strategies. In order to meet these objectives, we carry out experiments on two different datasets, the Brazilian forensic letters database and the IAM database. Through a series of comprehensive experiments, we show that both LBP- and LPQ-based classifiers are able to surpass previous results reported in the literature for the verification problem by about 5 percentage points. For the identification problem, the proposed approach using LPQ features is able to achieve accuracies of 96.7 and 99.2 on the BFL and IAM and databases respectively. Recently, the Institute of Automation of Chinese Academy of Sciences (CASIA) released the unconstrained online and offline Chinese handwriting databases CASIA-OLHWDB and CASIA-HWDB, which contain isolated character samples and handwritten texts produced by 1020 writers. This paper presents our benchmarking results using state-of-the-art methods on the isolated character datasets OLHWDB1.0 and HWDB1.0 (called DB1.0 in general), OLHWDB1.1 and HWDB1.1 (called DB1.1 in general). The DB1.1 covers 3755 Chinese character classes as in the level-1 set of GB2312-80. The evaluated methods include 1D and pseudo 2D normalization methods, gradient direction feature extraction from binary images and from gray-scale images, online stroke direction feature extraction from pen-down trajectory and from pen lifts, classification using the modified quadratic discriminant function (MQDF), discriminative feature extraction (DFE), and discriminative learning quadratic discriminant function (DLQDF). Our experiments reported the highest test accuracies 89.55 and 93.22 on the HWDB1.1 (offline) and OLHWDB1.1 (online), respectively, when using the MQDF classifier trained with DB1.1. When training with both the DB1.0 and DB1.1, the test accuracies on HWDB1.1 and OLHWDB are improved to 90.71 and 93.95 , respectively. Using DFE and DLQDF, the best results on HWDB1.1 and OLHWDB1.1 are 92.08 and 94.85 , respectively. Our results are comparable to the best results of the ICDAR2011 Chinese Handwriting Recognition Competition though we used less training samples. This paper proposes a novel method for offline text-independent writer identification by using convolutional neural network (CNN) and joint Bayesian, which consists of two stages, i.e. feature extraction and writer identification. In the stage of feature extraction, since a large number of data is essential to train an effective CNN model with high generalizability and the amount of handwriting is limited in writer identification, a data augmentation technique is first developed to generate thousands of handwriting images for each writer. Then a deep CNN network is designed to extract discriminative features to represent the properties of different writing styles, which is trained by using the generated handwriting images. In the stage of writer identification, the training dataset is used to train the CNN model for feature extraction and the joint Bayesian technique is employed to accomplish the task of writer identification based on the extracted CNN features. The proposed method is tested on two standard benchmark datasets, i.e. ICDAR2013 and CVL dataset. Experimental results demonstrate that the proposed method gets the best performance compared to the state-of-the-art approaches. Rapid movement generation models are described in the literature as an efficient tool to apprehend the handwriting behavior. Fields of application are diverse, including handwriting description, regeneration, and more recently OCR. In this paper, we propose a grapheme-based approach to offline Arabic writer identification and verification. Rather than extracting naturel graphemes from a training corpus using segmentation and clustering, it synthesizes its own graphemes based on the beta-elliptic model. Originality lies in the independence of the grapheme codebook from any training process, and the use of a model instead. One full and four partial codebooks are generated and tested. Using feature selection, raw codebooks are reduced in size with respect to FDR, FDR and cross-correlation, and random subsampling criteria. A total of 60 feature vectors are extracted using template matching, and evaluated with 411 individual writers from the IFN ENIT database. The results presented in this study demonstrated the wide representativity and the good generalization capability of synthetic codebooks. We obtained a top1 rate=90.02 and a top5 rate=96.35 for writer identification, and an EER=2.1 for writer verification. Our approach showed better properties than most of the surveyed techniques in terms of supported corpus size and identification rates. To the best of our knowledge, this study is among the first to exploit the concept of model-based synthetic codebooks in writer identification and verification. HighlightsUniversal synthetic codebooks are used for writer identification and verification.The beta-elliptic handwriting generation model is used to create the codebooks.Neither corpus-driven training nor prior segmentation is needed in this approach.Synthetic codebook demonstrated good generalization capabilities for Arabic.