Predicting a person's gender based on the iris texture has been explored by several researchers. This paper considers several dimensions of experimental work on this problem, including person-disjoint train and test, and the effect of cosmetics on eyelash occlusion and imperfect segmentation. We also consider the use of multi-layer perceptron and convolutional neural networks as classifiers, comparing the use of data-driven and hand-crafted features. Our results suggest that the gender-from-iris problem is more difficult than has so far been appreciated. Estimating accuracy using a mean of N person-disjoint train and test partitions, and considering the effect of makeup - a combination of experimental conditions not present in any previous work - we find a much weaker ability to predict gender-from-iris texture than has been suggested in previous work.
Gender is one soft biometric attribute, and gender recognition has been explored using biometric traits such as faces, fingerprints, gait and irises. The earliest work on gender-from-iris @cite_12 used a classifier based on decision trees, and reported an accuracy of about 75 extracted hand-crafted geometric and texture features from log-Gabor-filtered images in a dataset of over 57,000 images. The training and testing sets were not person-disjoint, which typically results in a higher estimated accuracy than can be expected for new persons.
@cite_12
2077265636
This paper is concerned in analyzing iris texture in order to determine “soft biometric”, attributes of a person, rather than identity. In particular, this paper is concerned with predicting the gender of a person based on analysis of features of the iris texture. Previous researchers have explored various approaches for predicting the gender of a person based on iris texture. We explore using different implementations of Local Binary Patterns from the iris image using the masked information. Uniform LBP with concatenated histograms significantly improves accuracy of gender prediction relative to using the whole iris image. Using a subject-disjoint test set, we are able to achieve over 91 correct gender prediction using the texture of the iris. To our knowledge, this is the highest accuracy yet achieved for predicting gender from iris texture. Recent research has explored the possibility of extracting ancillary information from primary biometric traits viz., face, fingerprints, hand geometry, and iris. This ancillary information includes personal attributes, such as gender, age, ethnicity, hair color, height, weight, and so on. Such attributes are known as soft biometrics and have applications in surveillance and indexing biometric databases. These attributes can be used in a fusion framework to improve the matching accuracy of a primary biometric system (e.g., fusing face with gender information), or can be used to generate qualitative descriptions of an individual (e.g., young Asian female with dark eyes and brown hair). The latter is particularly useful in bridging the semantic gap between human and machine descriptions of the biometric data. In this paper, we provide an overview of soft biometrics and discuss some of the techniques that have been proposed to extract them from the image and the video data. We also introduce a taxonomy for organizing and classifying soft biometric attributes, and enumerate the strengths and limitations of these attributes in the context of an operational biometric system. Finally, we discuss open research problems in this field. This survey is intended for researchers and practitioners in the field of biometrics. While the primary purpose for collecting biometric data (such as face images, iris, fingerprints, etc.) is for person recognition, yet recent advances in machine learning has shown the possibility of extracting auxiliary information from biometric data such as age, gender, health attributes, etc. These auxiliary attributes are sometimes referred to as soft biometrics. This automatic extraction of soft biometric attributes can happen without the user's agreement, thereby raising several privacy concerns. In this work, we design a technique that modifies a face image such that its gender as assessed by a gender classifier is perturbed, while its biometric utility as assessed by a face matcher is retained. Given an arbitrary biometric matcher and an attribute classifier, the proposed method systematically perturbs the input image such that the output of the attribute classifier is confounded, while the output of the biometric matcher is not significantly impacted. Experimental analysis convey the efficacy of the scheme in imparting gender privacy to face images. Gender is an important demographic attribute. Automated gender estimation has drawn significant interest in numerous applications such as surveillance, human-computer interaction, anonymous customized advertisement systems, image retrieval system as well as in fusion with primary biometric trait to improve the matching accuracy of a biometric system. Although studies have been proposed for gender estimation from face, fingerprint and iris images, none of the existing studies explore gender prediction from ocular images captured in mobile environment, which is the aim of this paper. We evaluate several textural descriptors in combination with Support Vector Machines (SVM) and Multi-layer Perceptron (MLP) on a large scale publicly available VISOB dataset captured using mobile devices. The best accuracy of 91.6 is obtained using Histogram of Gradient (HOG) descriptor in combination with MLP classifier. Previous researchers have explored various approaches for predicting the gender of a person based on the features of the iris texture. This paper is the first to predict gender directly from the same binary iris code that could be used for recognition. We found that the information for gender prediction is distributed across the iris, rather than localized in particular concentric bands. We also found that using selected features representing a subset of the iris region achieves better accuracy than using features representing the whole iris region. We used the measures of mutual information to guide the selection of bits from the iris code to use as features in gender prediction. Using this approach, with a person-disjoint training and testing evaluation, we were able to achieve 89 correct gender prediction using the fusion of the best features of iris code from the left and right eyes. Gender classification from multispectral periocular and iris images is a new topic on soft-biometric research. The feature extracted from RGB images and Near Infrared Images shows complementary information independent of the spectrum of the images. This paper shows that we canfusion these information improving the accuracy of gender classification. Most gender classification methods reported in the literature has used images from face databases and all the features for classification purposes. Experimental results suggest: (a) Features extracted in different scales can perform better than using only one feature in a single scale; (b) The periocular images performed better than iris images on VIS and NIR; c) The fusion of features on different spectral images NIR and VIS allows improve the accuracy; (c) The feature selection applied to NIR and VIS allows select relevant features and d) Our accuracy 90 is competitive with the state of the art. HighlightsPresentation of the new freely available TUM Gait from Audio, Image and Depth (GAID) database.Advancing gait based person identification by multimodal feature extraction.Gait based recognition of person traits: gender, age, height, shoe type.Baseline results and fusion for gait recognition using RGB, depth and audio. Recognizing people by the way they walk-also known as gait recognition-has been studied extensively in the recent past. Recent gait recognition methods solely focus on data extracted from an RGB video stream. With this work, we provide a means for multimodal gait recognition, by introducing the freely available TUM Gait from Audio, Image and Depth (GAID) database. This database simultaneously contains RGB video, depth and audio. With 305 people in three variations, it is one of the largest to-date. To further investigate challenges of time variation, a subset of 32 people is recorded a second time. We define standardized experimental setups for both person identification and for the assessment of the soft biometrics age, gender, height, and shoe type. For all defined experiments, we present several baseline results on all available modalities. These effectively demonstrate multimodal fusion being beneficial to gait recognition. Applications such as human---computer interaction, surveillance, biometrics and intelligent marketing would benefit greatly from knowledge of the attributes of the human subjects under scrutiny. The gender of a person is one such significant demographic attribute. This paper provides a review of facial gender recognition in computer vision. It is certainly not a trivial task to identify gender from images of the face. We highlight the challenges involved, which can be divided into human factors and those introduced during the image capture process. A comprehensive survey of facial feature extraction methods for gender recognition studied in the past couple of decades is provided. We appraise the datasets used for evaluation of gender classification performance. Based on the results reported, good performance has been achieved for images captured under controlled environments, but certainly there is still much work that can be done to improve the robustness of gender recognition under real-life environments. With periocular biometrics gaining attention recently, the goal of this paper is to investigate the effectiveness of local appearance features extracted from the periocular region images for soft biometrie classification. We extract gender and ethnicity information from the periocular region images using grayscale pixel intensities and periocular texture computed by Local Binary Patterns as our features and a SVM classifier. Results are presented on the visible spectrum periocular images obtained from the FRGC face dataset. For 4232 periocular images of 404 subjects, we obtain a baseline gender and ethnicity classification accuracy of 93 and 91 , respectively, using 5-fold cross validation. Furthermore, we show that fusion of the soft biometrie information obtained from our classification approach with the texture based periocular recognition approach results in an overall performance improvement. This paper employs machine learning techniques to develop models that predict gender based on the iris texture features. While there is a large body of research that explores biometrics as a means of verifying identity, there has been very little work done to determine if biometric measures can be used to determine specific human attributes. If it is possible to discover such attributes, they would be useful in situations where a biometric system fails to identify an individual that has not been enrolled, yet still needs to be identified. The iris was selected as the biometric to analyze for two major reasons: (1) quality methods have already been developed to segment and encode an iris image, (2) current iris encoding methods are conducive to selecting and extracting attributes from an iris texture and creating a meaningful feature vector. Prediction of gender characteristics from iris images has been investigated and some successful results have been reported in the literature, but without considering performance for different iris features and classifiers. This paper investigates for the first time an approach to gender prediction from iris images using different types of features (including a small number of very simple geometric features, texture features and a combination of geometric and texture features) and a more versatile and intelligent classifier structure. Our proposed approaches can achieve gender prediction accuracies of up to 90 in the BioSecure Database. Ear is a new class of relatively stable biometric that is invariant from childhood to old age. It is not affected with facial expressions, cosmetics and eye glasses. Human ear is one of the representative human biometrics with uniqueness and stability. Ear Recognition for Personal Identification using 2-D ear from a side face image is a challenging problem. This paper analyzes the efficiency of using texture features such as Gray Level Co-occurrence Matrix (GLCM), Local Binary Pattern (LBP) and Gabor Filter for the recognition of ears. The combination of three feature vectors was experimented with. It is found that the combination gives better results compared to when the features were used in isolation. Further, it is found that the recognition accuracy improves by extracting local texture features extracted from sub-images. The proposed technique is tested using an ear database which contains 442 ear images of 221 subjects and obtained 94.12 recognition accuracy. Personal identification problem has been a major field of research in recent years. Biometrics-based technologies that exploit fingerprints, iris, face, voice and palmprints, have been in the center of attention to solve this problem. Palmprints can be used instead of fingerprints that have been of the earliest of these biometrics technologies. A palm is covered with the same skin as the fingertips but has a larger surface, giving us more information than the fingertips. The major features of the palm are palm-lines, including principal lines, wrinkles and ridges. Using these lines is one of the most popular approaches towards solving the palmprint recognition problem. Another robust feature is the wavelet energy of palms. In this paper we used a hybrid feature which combines both of these features. Moreover, multispectral analysis is applied to improve the performance of the system. At the end, minimum distance classifier is used to match test images with one of the training samples. The proposed algorithm has been tested on a well-known multispectral palmprint dataset and achieved an average accuracy of 98.8 . Privacy is one of the most important social and political issues in our information society, characterized by a growing range of enabling and supporting technologies and services. Amongst these are communications, multimedia, biometrics, big data, cloud computing, data mining, internet, social networks, and audio-video surveillance. Each of these can potentially provide the means for privacy intrusion. De-identification is one of the main approaches to privacy protection in multimedia contents (text, still images, audio and video sequences and their combinations). It is a process for concealing or removing personal identifiers, or replacing them by surrogate personal identifiers in personal information in order to prevent the disclosure and use of data for purposes unrelated to the purpose for which the information was originally obtained. Based on the proposed taxonomy inspired by the Safe Harbour approach, the personal identifiers, i.e., the personal identifiable information, are classified as non-biometric, physiological and behavioural biometric, and soft biometric identifiers. In order to protect the privacy of an individual, all of the above identifiers will have to be de-identified in multimedia content. This paper presents a review of the concepts of privacy and the linkage among privacy, privacy protection, and the methods and technologies designed specifically for privacy protection in multimedia contents. The study provides an overview of de-identification approaches for non-biometric identifiers (text, hairstyle, dressing style, license plates), as well as for the physiological (face, fingerprint, iris, ear), behavioural (voice, gait, gesture) and soft-biometric (body silhouette, gender, age, race, tattoo) identifiers in multimedia documents. Privacy protection in multimedia.Taxonomy of the personal identifiers in multimedia contents.De-identification of non-biometrical identifiers.De-identification of physiological, behavioural and soft biometric identifiers. The periocular region, the region of the face surrounding the eyes, has gained increasing attention in biometrics in recent years. This region of the face is of particular interest when trying to identify a person whose face is partially occluded. We propose the novel idea of applying the information obtained from the periocular region to identify the gender of a person, which is a type of soft biometrie recognition. We gradually narrow the region of interest of the face to explore the feasibility of using smaller, eye-centered regions for building a robust gender classifier around the periocular region alone. Our experimental results show that at least an 85 classification rate is still obtainable using only the periocular region with a database of 936 low resolution images collected from the web. Recently, pedestrian attributes like gender, age and clothing etc., have been used as soft biometric traits for recognizing people. Unlike existing methods that assume the independence of attributes during their prediction, we propose a multi-label convolutional neural network (MLCNN) to predict multiple attributes together in a unified framework. Firstly, a pedestrian image is roughly divided into multiple overlapping body parts, which are simultaneously integrated in the multi-label convolutional neural network. Secondly, these parts are filtered independently and aggregated in the cost layer. The cost function is a combination of multiple binary attribute classification cost functions. Moreover, we propose an attribute assisted person re-identification method, which fuses attribute distances and low-level feature distances between pairs of person images to improve person re-identification performance. Extensive experiments show: 1) the average attribute classification accuracy of the proposed method is 5.2 and 9.3 higher than the SVM-based method on three public databases, VIPeR and GRID, respectively; 2) the proposed attribute assisted person re-identification method is superior to existing approaches. We report on an experiment in which observers were asked to browse a set of 100 iris images and group them into categories based on similarity of overall texture appearance. Results indicate that there is a natural categorization of iris images into a small number of high-level categories, and then also into subcategories. Also, the categorization reflects the Caucasian Asian ethnicity of the person. This iris texture categorization has potential application in, for example, creating an indexing algorithm to speed search of an iris database and or determining soft biometric traits of a person. We consider the problem of perturbing a face image in such a way that it cannot be used to ascertain soft biometric attributes such as age, gender and race, but can be used for automatic face recognition. Such an exercise is useful for extending different levels of privacy to a face image in a central database. In this work, we focus on masking the gender information in a face image with respect to an automated gender estimation scheme, while retaining its ability to be used by a face matcher. To facilitate this privacy-enhancing technique, the input face image is combined with another face image via a morphing scheme resulting in a mixed image. The mixing process can be used to progressively modify the input image such that its gender information is progressively suppressed; however, the modified images can still be used for recognition purposes if necessary. Preliminary experiments on the MUCT database suggest the potential of the scheme in imparting “differential privacy” to face images. We consider the task of predicting various traits of a person given an image of their face. We estimate both objective traits, such as gender, ethnicity and hair-color; as well as subjective traits, such as the emotion a person expresses or whether he is humorous or attractive. For sizeable experimentation, we contribute a new Face Attributes Dataset (FAD), having roughly 200,000 attribute labels for the above traits, for over 10,000 facial images. Due to the recent surge of research on Deep Convolutional Neural Networks (CNNs), we begin by using a CNN architecture for estimating facial attributes and show that they indeed provide an impressive baseline performance. To further improve performance, we propose a novel approach that incorporates facial landmark information for input images as an additional channel, helping the CNN learn better attribute-specific features so that the landmarks across various training images hold correspondence. We empirically analyse the performance of our method, showing consistent improvement over the baseline across traits. As the standard iris biometric algorithm ''sees'' them, the left and right irises of the same person are as different as irises of unrelated people. Similarly, in terms of iris biometric matching, the eyes of identical twins are as different as irises of unrelated people. The left and right eyes of an individual or the eyes of identical twins are examples of genetically identical irises. In experiments with human observers viewing pairs of iris images acquired using an iris biometric system, we have found that there is recognizable similarity in the left and right irises of an individual and in the irises of identical twins. This result suggests that iris texture analysis different from that performed in the standard iris biometric algorithm may be able to answer questions that iris biometrics cannot answer.