3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> Although Augmented Reality technology was first developed over forty years ago, there has been little survey work giving an overview of recent research in the field. This paper reviews the ten-year development of the work presented at the ISMAR conference and its predecessors with a particular focus on tracking, interaction and display research. It provides a roadmap for future augmented reality research which will be of great value to this relatively young field, and also for helping researchers decide which topics should be explored when they are beginning their own studies in the area. <s> BIB001 </s> 3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> This paper presents the haptic interface system that consists of a base object and a haptic device. The desired force response is achieved by the combination of the real force response of the base object and the virtual force exerted by the haptic device. The proposed haptic augmented reality (AR) system can easily generate the force response of a visco-elastic object with a cheap haptic device and a base object that has the similar visco-elastic property to the target object. In the demonstration, the force response of the target object was generated by using a haptic device only (VR) and using both a haptic device and a base object (AR), respectively. The evaluation experiments by participants show that the AR method has better performance than the VR method. This result indicates the potential of the proposed haptic AR interface. <s> BIB002 </s> 3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> This paper presents a survey of the main results obtained in the field of “pseudo-haptic feedback”: a technique meant to simulate haptic sensations in virtual environments using visual feedback and properties of human visuo-haptic perception. Pseudo-haptic feedback uses vision to distort haptic perception and verges on haptic illusions. Pseudo-haptic feedback has been used to simulate various haptic properties such as the stiffness of a virtual spring, the texture of an image, or the mass of a virtual object. This paper describes the several experiments in which these haptic properties were simulated. It assesses the definition and the properties of pseudo-haptic feedback. It also describes several virtual reality applications in which pseudo-haptic feedback has been successfully implemented, such as a virtual environment for vocational training of milling machine operations, or a medical simulator for training in regional anesthesia procedures. <s> BIB003 </s> 3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> The technical enablers for mobile augmented reality (MAR) are becoming robust enough to allow the development of MAR services that are truly valuable for consumers. Such services would provide a novel interface to the ubiquitous digital information in the physical world, hence serving in great variety of contexts and everyday human activities. To ensure the acceptance and success of future MAR services, their development should be based on knowledge about potential end users' expectations and requirements. We conducted 16 semi-structured interview sessions with 28 participants in shopping centres, which can be considered as a fruitful context for MAR services. We aimed to elicit new knowledge about (1) the characteristics of the expected user experience and (2) central user requirements related to MAR in such a context. From a pragmatic viewpoint, the participants expected MAR services to catalyse their sense of efficiency, empower them with novel context-sensitive and proactive functionalities and raise their awareness of the information related to their surroundings with an intuitive interface. Emotionally, MAR services were expected to offer stimulating and pleasant experiences, such as playfulness, inspiration, liveliness, collectivity and surprise. The user experience categories and user requirements that were identified can serve as targets for the design of user experience of future MAR services. <s> BIB004 </s> 3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> Equipped with powerful processors, cameras for capturing still images and video, and a range of sensors capable of tracking location, orientation and motion of the user, modern smartphones offer a sophisticated platform for implementing handheld augmented reality (AR) applications. Despite the advances in research and development, implementing AR applications for the smartphone platform remains a challenge due to many open problems related to navigation, contextawareness, visualization, usability and interaction design, as well as content creation and sharing. This paper surveys a number of open challenges and issues, trade-offs and possible solutions in implementing handheld AR applications. <s> BIB005 </s> 3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> Lately, mobile augmented reality (AR) has become very popular and is used for many commercial and product promotional activities. However, in almost all mobile AR applications, the user only views annotated information or the preset motion of the virtual object in an AR environment and is unable to interact with the virtual objects as if he/she were interacting with real objects in the real environment. In this paper, in an attempt to realize enhanced intuitive and realistic object manipulation in the mobile AR environment, we propose an integrated view-input AR interaction method, which integrates user device manipulation and virtual object manipulation. The method enables the user to hold a 3D virtual object by touching the displayed object on the 2D touch screen of a mobile device, and to move and rotate the object by moving and rotating the mobile device while viewing the held object by way of the 2D screen of the mobile device. Based on this concept, we implemented three types of integrated methods, namely the Rod, Center, and Touch methods, and conducted a user study to investigate the baseline performance metrics of the proposed method on an AR object manipulation task. The Rod method achieved the highest success rate (91%). Participants' feedback indicated that this is because the Rod method is the most natural, and evoked a fixed mental model that is conceivable in the real environment. These results indicated that visualizing the manipulation point on the screen and restricting the user's interactivity with virtual objects from the user's position of view based on a conceivable mental model would be able to aid the user to achieve precise manipulation. <s> BIB006 </s> 3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> The boom in the capabilities and features of mobile devices, like smartphones, tablets, and wearables, combined with the ubiquitous and affordable Internet access and the advances in the areas of cooperative networking, computer vision, and mobile cloud computing transformed mobile augmented reality (MAR) from science fiction to a reality. Although mobile devices are more constrained computationalwise from traditional computers, they have a multitude of sensors that can be used to the development of more sophisticated MAR applications and can be assisted from remote servers for the execution of their intensive parts. In this paper, after introducing the reader to the basics of MAR, we present a categorization of the application fields together with some representative examples. Next, we introduce the reader to the user interface and experience in MAR applications and continue with the core system components of the MAR systems. After that, we discuss advances in tracking and registration, since their functionality is crucial to any MAR application and the network connectivity of the devices that run MAR applications together with its importance to the performance of the application. We continue with the importance of data management in MAR systems and the systems performance and sustainability, and before we conclude this survey, we present existing challenging problems. <s> BIB007 </s> 3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A Review <s> VII. CONCLUSION AND FUTURE DIRECTIONS <s> Shipbuilding companies are upgrading their inner workings in order to create Shipyards 4.0, where the principles of Industry 4.0 are paving the way to further digitalized and optimized processes in an integrated network. Among the different Industry 4.0 technologies, this paper focuses on augmented reality, whose application in the industrial field has led to the concept of industrial augmented reality (IAR). This paper first describes the basics of IAR and then carries out a thorough analysis of the latest IAR systems for industrial and shipbuilding applications. Then, in order to build a practical IAR system for shipyard workers, the main hardware and software solutions are compared. Finally, as a conclusion after reviewing all the aspects related to IAR for shipbuilding, it proposed an IAR system architecture that combines cloudlets and fog computing, which reduce latency response and accelerate rendering tasks while offloading compute intensive tasks from the cloud. <s> BIB008
Currently, many of the existing handheld mobile AR applications are not considered very practical due to insufficient functionality and they do not fully answer to the needs of the users BIB004 ,  . Many design and technical challenges still remain and 3D object manipulation (including 3D object translation and rotation) is one of them. In order for handheld mobile AR to become widely accepted, the users must be able to create AR contents by positioning and rotating virtual objects in the real environment BIB005 ,  . After discussed the remaining issues related with 3D object manipulation techniques in handheld mobile AR and also their substantial effects in many fields, future directions for research in interaction techniques for 3D object manipulation in handheld mobile AR can be identified in the areas of occlusion, position deviation, accuracy, speed, intuitiveness and large-range manipulation that go beyond hybrid interaction and realistic AR experience as well as the wireless networking. Speed and accuracy rate are two indicators in most AR-related user studies  , thus also have been included as VOLUME 7, 2019 one of the future directions while solutions can be focused on speeding up the 3D object manipulation with greater accuracy rate in handheld mobile AR. Realistic AR experience also had been added as one of the future directions while solutions can be focused on improving the AR experience. Haptic aspect BIB006 , BIB002 , BIB003 for example, which is importance when AR system is applied in the real-world tasks such as assembly-related tasks while physic simulation that applicable on handheld mobile AR like force and deflection feedback can be visually done to improve the user's AR experience like he/she is manipulating the real object. Wireless networking is one more issue to be focused on. Wireless networking is needed to communicate with other people and computers while on the run. Dynamic and flexible handheld mobile AR will rely on up-to-the-second information that cannot possibly be stored on the computing device before application run-time BIB008 , BIB007 . In AR, wireless networking is crucially important in handheld tour guide and applications. Location-based AR applications such as AR outdoor navigation system always needs wireless networking to access to a remote server to update the current information BIB001 . Even a tracking process that requires GPS also needs the wireless network to function properly. For 3D object manipulation, the wireless network is essential, when the 3D content registered are stored in the remote server or involving multiple users. The main issue related to wireless networking in handheld mobile AR may point to its stability and speed especially in rural area. The researches and studies in this area still lack and more effort should be put into this particular area. Based on the remaining issue we have discovered together with the specific issues stated previously in Table 1, 2 and 3 and other aspects stated as speed, accuracy, realistic AR experience, and wireless networking, we categorized potential research directions followed by each interaction category in Table 6 as a rough guide for readers and researchers. This paper reviewed the field of interaction techniques for 3D object manipulation in handheld mobile AR. Specifically, the three (3) primary interaction technique categories accessible until 2018 are touch-based interaction, mid-air gestures-based interaction and device-based interaction techniques. It provides insights into the fundamentals of interaction techniques for 3D object manipulation, as well as issues relating to each technique category. These interaction techniques focus on achieving 3D object manipulation tasks, that is, the complete 6DOF of 3D object manipulation of virtual content in handheld mobile AR environments. Besides 3D object manipulation, further discussion in addition to improving the user's AR experiences, including occlusion, hand and finger tracking or recognition, and other specific issues relating to each technique should be considered to achieve a quality of interaction experience as high as possible. She has started research on augmented reality, which is currently her main research area. She has completed the M.S. research mode degree in a short period of three semesters, and her research was vision-based tracking in augmented reality. In 2013, she joined the Human Interface Technology Laboratory New Zealand (HITLabNZ), University of Canterbury, as a Researcher, where she has completed her research in the Ph.D. degree in three years. She is currently the Head of Mixed and Virtual Environment Research Lab (Mivielab), UTM. She is currently a Senior Lecturer with the Universiti Teknologi Malaysia (UTM), Johore, Malaysia. Her research interests include augmented reality and mixed reality environments. VOLUME 7, 2019 