A tracking system that will be used for augmented reality applications has two main requirements: accuracy and frame rate. The first requirement is related to the performance of the pose estimation algorithm and how accurately the tracking system can find the position and orientation of the user in the environment. Accuracy problems of current tracking devices, considering that they are low-cost devices, cause static errors during this motion estimation process. The second requirement is related to dynamic errors (the end-to-end system delay, occurring because of the delay in estimating the motion of the user and displaying images based on this estimate). This paper investigates combining the vision-based estimates with measurements from other sensors, GPS and IMU, in order to improve the tracking accuracy in outdoor environments. The idea of using Fuzzy Adaptive Multiple Models was investigated using a novel fuzzy rule-based approach to decide on the model that results in improved accuracy and faster convergence for the fusion filter. Results show that the developed tracking system is more accurate than a conventional GPS–IMU fusion approach due to additional estimates from a camera and fuzzy motion models. The paper also presents an application in cultural heritage context running at modest frame rates due to the design of the fusion algorithm.
Augmented Reality applications require the tracking of moving objects in real-time. Tracking is defined as the measurement of object position and orientation in a scene coordinate system. We present a new combination of silicon micromachined accelerometers and gyroscopes which have been assembled into a six degree of freedom (6 DoF) inertial tracking system. This inertial tracker is used in combination with a vision-based tracking system which will enable us to build affordable, light-weight, fully mobile tracking systems for Augmented Reality applications in the future. Our work stems from a program focused on developing tracking technologies for wide-area augmented realities in unprepared outdoor environments. Other participants in the Defense Advanced Research Projects Agency (Darpa) funded Geospatial Registration of Information for Dismounted Soldiers (Grids) program included University of North Carolina at Chapel Hill and Raytheon. We describe a hybrid orientation tracking system combining inertial sensors and computer vision. We exploit the complementary nature of these two sensing technologies to compensate for their respective weaknesses. Our multiple-sensor fusion is novel in augmented reality tracking systems, and the results demonstrate its utility. This paper presents a method to fuse measurements from a rigid sensor rig with a stereo vision system and a set of 6 DOF inertial sensors for egomotion estimation and external structure estimation. No assumptions about the sampling rate of the two sensors are made. The basic idea is a common state vector and a common dynamic description which is stored together with the time instant of the estimation. Every time one of the sensor sends new data, the corresponding filter equation is updated and a new estimation is generated. In this paper the filter equations for an extended Kalman filter are derived together with considerations of the tuning. Simulations with real sensor data show the successful implementation of this concept. © 2004 Wiley Periodicals, Inc. 