A survey of hand gesture dialogue modeling for map navigation <s> RELATED RESEARCH <s> The use of hand gestures provides an attractive alternative to cumbersome interface devices for human-computer interaction (HCI). In particular, visual interpretation of hand gestures can help in achieving the ease and naturalness desired for HCI. This has motivated a very active research area concerned with computer vision-based analysis and interpretation of hand gestures. We survey the literature on visual interpretation of hand gestures in the context of its role in HCI. This discussion is organized on the basis of the method used for modeling, analyzing, and recognizing gestures. Important differences in the gesture interpretation approaches arise depending on whether a 3D model of the human hand or an image appearance model of the human hand is used. 3D hand models offer a way of more elaborate modeling of hand gestures but lead to computational hurdles that have not been overcome given the real-time requirements of HCI. Appearance-based models lead to computationally efficient "purposive" approaches that work well under constrained situations but seem to lack the generality desirable for HCI. We also discuss implemented gestural systems as well as other potential applications of vision-based gesture recognition. Although the current progress is encouraging, further theoretical as well as computational advances are needed before gestures can be widely used for HCI. We discuss directions of future research in gesture recognition, including its integration with other natural modes of human-computer interaction. <s> BIB001 </s> A survey of hand gesture dialogue modeling for map navigation <s> RELATED RESEARCH <s> Recent advances in sensing technology have enabled a new generation of tabletop displays that can sense multiple points of input from several users simultaneously. However, apart from a few demonstration techniques [17], current user interfaces do not take advantage of this increased input bandwidth. We present a variety of multifinger and whole hand gestural interaction techniques for these displays that leverage and extend the types of actions that people perform when interacting on real physical tabletops. Apart from gestural input techniques, we also explore interaction and visualization techniques for supporting shared spaces, awareness, and privacy. These techniques are demonstrated within a prototype room furniture layout application, called RoomPlanner. <s> BIB002 </s> A survey of hand gesture dialogue modeling for map navigation <s> RELATED RESEARCH <s> This paper presents a bare-hand controlled augmented reality (AR) map navigation system. A set of symbolic hand gestures is defined as controlling commands. Users can directly move their hands on a real map. When certain hand gestures are recognized the relative geography information, video clip or 3D scene would be played based on some display devices such as the HMD and computer screen. Our system is concentrated on the popular family use. A single Web cam is used as the video input device. A novel hand segmentation method is presented to solve the problems such as light changing and un-uniformed background. Based on this approach a finger finding and hand gestures recognizing algorithm is developed. The performance of the system proved that our methods are robust and effective. And it is easy to configure and use for family users. <s> BIB003 </s> A survey of hand gesture dialogue modeling for map navigation <s> RELATED RESEARCH <s> In this paper, we describe a system of multi-touch tabletop display and its control algorithm for Google-earthTM that utilizes hand gesture as mouse free interaction. The system adopts well known FTIR technique. The hand gesture of necessary instruction is predefined according to the number, position, and movement of the fingertips which are obtained from multi-touch of a single user. The system consists of a beam-projector and an acrylic screen attaching infrared LED as light source, and an infrared camera for capturing the fingertip image. Input image is preprocessed with simple morphological method to remove the noise and to determine the fingertip region. In recognition process, gesture commands are recognized by comparing the preprocessed image with predefined gesture model of fingertips. In detail, firstly the number of the spot; fingertip mark, angles among the spots, and Euclidean distance between two spots are calculated, and then the values are compared with the information of the model. The effectiveness of the system can be proved through the experimental results. <s> BIB004 </s> A survey of hand gesture dialogue modeling for map navigation <s> RELATED RESEARCH <s> In this work we describe a 3D authoring tool which takes advantage of multimodal interfaces such as gestures and speech. This tool allows real-time Augmented Reality aimed to aid the tasks of interior architects and designers. This approach intends to be an alternative to traditional techniques. The main benefit of using a multimodal based augmented reality system is the provision of a more transparent, flexible, efficient and expressive means of human-computer interaction. <s> BIB005 </s> A survey of hand gesture dialogue modeling for map navigation <s> RELATED RESEARCH <s> A new vision-based framework and system for human–computer interaction in an Augmented Reality environment is presented in this article. The system allows the users to interact with computer-generated virtual objects using their hands directly. With an efficient color segmentation algorithm, the system is adaptable to different light conditions and backgrounds. It is also suitable for real-time applications. The dominant features on the palm are detected and tracked to estimate the camera pose. After the camera pose relative to the user's hand has been reconstructed, 3D virtual objects can be augmented naturally onto the palm for the user to inspect and manipulate. With off-the-shelf web camera and computer, natural bare-hand based interactions with 2D and 3D virtual objects can be achieved with low cost. <s> BIB006 </s> A survey of hand gesture dialogue modeling for map navigation <s> RELATED RESEARCH <s> This paper covers the use of depth sensors such as Microsoft Kinect and ASUS Xtion to provide a natural user interface (NUI) for controlling 3-D (three-dimensional) virtual globes such as Google Earth (including its Street View mode), Bing Maps 3D, and NASA World Wind. The paper introduces the Microsoft Kinect device, briefly describing how it works (the underlying technology by PrimeSense), as well as its market uptake and application potential beyond its original intended purpose as a home entertainment and video game controller. The different software drivers available for connecting the Kinect device to a PC (Personal Computer) are also covered, and their comparative pros and cons briefly discussed. We survey a number of approaches and application examples for controlling 3-D virtual globes using the Kinect sensor, then describe Kinoogle, a Kinect interface for natural interaction with Google Earth, developed by students at Texas A&M University. Readers interested in trying out the application on their own hardware can download a Zip archive (included with the manuscript as additional files 1, 2, & 3) that contains a 'Kinnogle installation package for Windows PCs'. Finally, we discuss some usability aspects of Kinoogle and similar NUIs for controlling 3-D virtual globes (including possible future improvements), and propose a number of unique, practical 'use scenarios' where such NUIs could prove useful in navigating a 3-D virtual globe, compared to conventional mouse/3-D mouse and keyboard-based interfaces. <s> BIB007
There has been a lot of study on hand gesture researches since the decade BIB001   . In this paper, hand gesture is divided into contact based and non-contact based which mean the former use haptic sensor and latter use sensor devices like visual capture device that user no need to wear any devices on hand. However, contact based hand gestures become popular among public since the first induction of multi-touch gesture from Apple Mac Book. There are research studies on this technique BIB002 BIB004 before the introduction of multi-touch gesture. Wu and Balakrishnan BIB002 had worked on a gesture set for interaction with Tabletop displays. In their study, user can use multi-finger and whole hand gestural doing simple interaction e.g. tap, flick, drag, and so on. Whether the above technique using contact-based sensor devices but their fundamental is the same with non-contact technology, both used specified hand gesture dialogue to manipulate on the computer. Non-contact based hand gesture or vision-based hand gesture normally equipped with at least one computer vision sensor devices like camera. Most researchers like to apply this technique tothe augmented reality environment BIB006 BIB005 BIB003 which can make their researches simulateto the real world environment. In study of Malik and Laszlo  , they used two cameras to track stereo image of hand gesture above a planar surface to design a visual touchpad. With stereo camera, they successfully solve the occlusion problem with the single camera. This state that multi camera hasa greater advantage than the single camera. Kinect sensor device is designed based on this concept with two build in camera and one infrared camera. Kinoogle is a recent research using the Kinect sensor to achieve natural interaction with hand and body gesture to navigate 3D globe simulator BIB007 . Whether the combination of hand and body ISSN: 2252-4274 (Print) ISSN: 2252-5459 (Online) gesture can be attained more functionality but the hand gesture is not fully in use and modeled with a maximum. Hand gesture dialogue should be modeled to widely in use like human use hand gesture intuitively when communication. Implementation of appropriate hand gesture dialogue with this system will increase the effectiveness of the system such as user performance and intuitiveness. As the development of computer hardware becomes more and more advanced, this stimulates the demand of hand gesture dialogue. The hand gesture dialogue is undoubtedly  BIB001 important in many areas. The positive growing of hand gesture dialogue greatly encourages the following researchers to model more effective, intuitive and natural hand gesture dialogue in map navigation. This paper's aim is to investigate if hand gesture dialogue modeling in map navigation can ease the user's burden and improve their immersion by distributing the tasks to the most appropriate hand gestures dialogue.