Personal devices (e.g. laptops, tablets, and mobile phones) are conventional in daily life and have the ability to store users' private data. The security problems related to these appliances have become a primary concern for both users and researchers. In this paper, we analyse first-person-view videos to develop a personalized user authentication mechanism. Our proposed algorithm generates provisional image-based passwords which benefit a variety of purposes such as unlocking a mobile device or fallback authentication. First, representative frames are extracted from the egocentric videos. Then, they are split into distinguishable segments before a clustering procedure is applied to discard repetitive scenes. The whole process aims to retain memorable images to form the authentication challenges. We integrate eye tracking data to select informative sequences of video frames and suggest a blurriness-based method if an eye-facing camera is not available. To evaluate our system, we perform experiments in different settings including object-interaction activities and traveling contexts. Even though our mechanism produces variable graphical passwords, the log-in effort for the user is comparable with approaches based on static challenges. We verified the authentication challenges in the presence of a random and an informed attacker who is familiar with the environment and observed that the time required and the number of attempts are significantly higher than for the legitimate user, making it possible to detect attacks on the authentication system.
The release of smartglasses such as JINS MEME @cite_7 or Google Glass has introduced new opportunities and challenges in user authentication. Li @cite_34 takes advantage of head motions when the user wears smartglasses to recognize the wearer. We usually move our heads in specific patterns when listening to music. Thus, the authors analysed these distinct movements to identify the wearers.
@cite_34 @cite_7
2335819971 2295333746
In this paper, we present the design, implementation and evaluation of a user authentication system, Headbanger, for smart head-worn devices, through monitoring the user's unique head-movement patterns in response to an external audio stimulus. Compared to today's solutions, which primarily rely on indirect authentication mechanisms via the user's smartphone, thus cumbersome and susceptible to adversary intrusions, the proposed head-movement based authentication provides an accurate, robust, light-weight and convenient solution. Through extensive experimental evaluation with 95 participants, we show that our mechanism can accurately authenticate users with an average true acceptance rate of 95.57 while keeping the average false acceptance rate of 4.43 . We also show that even simple head-movement patterns are robust against imitation attacks. Finally, we demonstrate our authentication algorithm is rather light-weight: the overall processing latency on Google Glass is around 1.9 seconds. To enable precise detection of mental and physical states of users in a daily life, we have been developing an eyewear to measure eye and body movement in a unrestricted way. The horizontal and vertical EOG (electrooculogram) signals are measured and amplified with three met al dry electrodes placed near nasion and both sides of rhinion, of which positions correspond to the bridge and nose pads of eyewear, respectively. The user's mental states like drowsiness, sleepiness, fatigue, or interest to objects can be identified by the movements and blinking of the eyes extracted from the measured EOG. And the six-axis motion sensor (three-axis accelerometer and three-axis gyroscope) mounted in the eyewear measures the body motion. As the sensor located near the head is on the body axis, this eyewear is suitable to measure user's movement or shift of center of gravity during physical exercise with a high precision. The measured signals are used to extract various events of eye and body movement by the mounted microcontroller chip, or can be transmitted to the external devices via Bluetooth communication. This device can enable you to look into "yourself", as well as outer scenes. In this presentation, the outline of the eyewear is introduced and some possible applications are shown.