We propose a new iris presentation attack detection method using three-dimensional features of an observed iris region estimated by photometric stereo. Our implementation uses a pair of iris images acquired by a common commercial iris sensor (LG 4000). No hardware modifications of any kind are required. Our approach should be applicable to any iris sensor that can illuminate the eye from two different directions. Each iris image in the pair is captured under near-infrared illumination at a different angle relative to the eye. Photometric stereo is used to estimate surface normal vectors in the non-occluded portions of the iris region. The variability of the normal vectors is used as the presentation attack detection score. This score is larger for a texture that is irregularly opaque and printed on a convex contact lens, and is smaller for an authentic iris texture. Thus the problem is formulated as binary classification into (a) an eye wearing textured contact lens and (b) the texture of an actual iris surface (possibly seen through a clear contact lens). Experiments were carried out on a database of approx. 2,900 iris image pairs acquired from approx. 100 subjects. Our method was able to correctly classify over 95 of samples when tested on contact lens brands unseen in training, and over 98 of samples when the contact lens brand was seen during training. The source codes of the method are made available to other researchers.
Another idea employing 3D features of the eye is based on detection of the Purkinje reflections , specularities that occur at the outer and inner boundaries of the cornea, and the outer and inner boundaries of the lens. Lee al @cite_2 follow this idea and apply a human eye model to calculate a theoretical positions of Purkinje reflections used later to verify the correctness of the observed specularities. The method proposed in this paper is different from the above method since it does not detect and use Purkinje reflections in the PAD. Also, the higher-order Purkinje reflections can be difficult to detect and may still exist for a person wearing contact lenses.
@cite_2
2158363907 2032118045 1946259682 2040322660
This paper presents a general theory for the remote estimation of the point-of-gaze (POG) from the coordinates of the centers of the pupil and corneal reflections. Corneal reflections are produced by light sources that illuminate the eye and the centers of the pupil and corneal reflections are estimated in video images from one or more cameras. The general theory covers the full range of possible system configurations. Using one camera and one light source, the POG can be estimated only if the head is completely stationary. Using one camera and multiple light sources, the POG can be estimated with free head movements, following the completion of a multiple-point calibration procedure. When multiple cameras and multiple light sources are used, the POG can be estimated following a simple one-point calibration procedure. Experimental and simulation results suggest that the main sources of gaze estimation errors are the discrepancy between the shape of real corneas and the spherical corneal shape assumed in the general theory, and the noise in the estimation of the centers of the pupil and corneal reflections. A detailed example of a system that uses the general theory to estimate the POG on a computer screen is presented. This paper provides a comprehensive analysis of exactly what visual information about the world is embedded within a single image of an eye. It turns out that the cornea of an eye and a camera viewing the eye form a catadioptric imaging system. We refer to this as a corneal imaging system. Unlike a typical catadioptric system, a corneal one is flexible in that the reflector (cornea) is not rigidly attached to the camera. Using a geometric model of the cornea based on anatomical studies, its 3D location and orientation can be estimated from a single image of the eye. Once this is done, a wide-angle view of the environment of the person can be obtained from the image. In addition, we can compute the projection of the environment onto the retina with its center aligned with the gaze direction. This foveated retinal image reveals what the person is looking at. We present a detailed analysis of the characteristics of the corneal imaging system including field of view, resolution and locus of viewpoints. When both eyes of a person are captured in an image, we have a stereo corneal imaging system. We analyze the epipolar geometry of this stereo system and show how it can be used to compute 3D structure. The framework we present in this paper for interpreting eye images is passive and non-invasive. It has direct implications for several fields including visual recognition, human-machine interfaces, computer graphics and human affect studies. We present a method for estimating eye gaze direction, which represents a departure from conventional eye gaze estimation methods, the majority of which are based on tracking specific optical phenomena like corneal reflection and the Purkinje images. We employ an appearance manifold model, but instead of using a densely sampled spline to perform the nearest manifold point query, we retain the original set of sparse appearance samples and use linear interpolation among a small subset of samples to approximate the nearest manifold point. The advantage of this approach is that since we are only storing a sparse set of samples, each sample can be a high dimensional vector that retains more representational accuracy than short vectors produced with dimensionality reduction methods. The algorithm was tested with a set of eye images labelled with ground truth point-of-regard coordinates. We have found that the algorithm is capable of estimating eye gaze with a mean angular error of 0.38 degrees, which is comparable to that obtained by commercially available eye trackers. This paper presents an active contour model to accurately detect pupil boundary in order to improve the performance of iris recognition systems. The contour model takes into consideration that an actual pupil boundary is a near-circular contour rather than a perfect circle. Two types of controlling force models, introduced as internal and external forces, are designed to properly activate the contour and locate it over the pupil boundary. The internal forces are designed to smooth the curve as well as to keep it close to a circular shape by pushing the contour vertices to their local radial mean. The external forces, which are responsible for pulling the contour vertices toward the pupil boundary, are designed based on a circular-curve gradient measurement with a proper angular range with respect to the contour center. In addition, an iterative algorithm has been developed in order to capture limbus and eyelids. The developed algorithm iteratively searches the limbus and eyelids boundaries and excludes the detected eyelids areas that cover the iris. Excluding the eyelids leads to a more precise search for limbus in the next iteration and the search is completed when the circular parameters of the limbus converge to fixed values. The eyelid contours are modeled as elliptic curves considering the spherical shape of an eyeball and the search is based on the expected contour in different degrees of eye openness.