A survey of datasets for visual tracking <s> The PROST dataset <s> We present a novel algorithm (which we call "Frag- Track") for tracking an object in a video sequence. The template object is represented by multiple image fragments or patches. The patches are arbitrary and are not based on an object model (in contrast with traditional use of modelbased parts e.g. limbs and torso in human tracking). Every patch votes on the possible positions and scales of the object in the current frame, by comparing its histogram with the corresponding image patch histogram. We then minimize a robust statistic in order to combine the vote maps of the multiple patches. A key tool enabling the application of our algorithm to tracking is the integral histogram data structure [18]. Its use allows to extract histograms of multiple rectangular regions in the image in a very efficient manner. Our algorithm overcomes several difficulties which cannot be handled by traditional histogram-based algorithms [8, 6]. First, by robustly combining multiple patch votes, we are able to handle partial occlusions or pose change. Second, the geometric relations between the template patches allow us to take into account the spatial distribution of the pixel intensities - information which is lost in traditional histogram-based algorithms. Third, as noted by [18], tracking large targets has the same computational cost as tracking small targets. We present extensive experimental results on challenging sequences, which demonstrate the robust tracking achieved by our algorithm (even with the use of only gray-scale (noncolor) information). <s> BIB001 </s> A survey of datasets for visual tracking <s> The PROST dataset <s> In this paper, we address the problem of learning an adaptive appearance model for object tracking. In particular, a class of tracking techniques called “tracking by detection” have been shown to give promising results at real-time speeds. These methods train a discriminative classifier in an online manner to separate the object from the background. This classifier bootstraps itself by using the current tracker state to extract positive and negative examples from the current frame. Slight inaccuracies in the tracker can therefore lead to incorrectly labeled training examples, which degrades the classifier and can cause further drift. In this paper we show that using Multiple Instance Learning (MIL) instead of traditional supervised learning avoids these problems, and can therefore lead to a more robust tracker with fewer parameter tweaks. We present a novel online MIL algorithm for object tracking that achieves superior results with real-time performance. <s> BIB002 </s> A survey of datasets for visual tracking <s> The PROST dataset <s> Tracking-by-detection is increasingly popular in order to tackle the visual tracking problem. Existing adaptive methods suffer from the drifting problem, since they rely on self-updates of an on-line learning method. In contrast to previous work that tackled this problem by employing semi-supervised or multiple-instance learning, we show that augmenting an on-line learning method with complementary tracking approaches can lead to more stable results. In particular, we use a simple template model as a non-adaptive and thus stable component, a novel optical-flow-based mean-shift tracker as highly adaptive element and an on-line random forest as moderately adaptive appearance-based learner. We combine these three trackers in a cascade. All of our components run on GPUs or similar multi-core systems, which allows for real-time performance. We show the superiority of our system over current state-of-the-art tracking methods in several experiments on publicly available data. <s> BIB003 </s> A survey of datasets for visual tracking <s> The PROST dataset <s> Recently, several image gradient and edge based features have been introduced. In unison, they all discovered that object shape is a strong cue for recognition and tracking. Generally their basic feature extraction relies on pixel-wise gradient or edge computation using discrete filter masks, while scale invariance is later achieved by higher level operations like accumulating histograms or abstracting edgels to line segments. In this paper we show a novel and fast way to compute region based gradient features which are scale invariant themselves. We developed specialized, quick learnable weak classifiers that are integrated into our adaptively boosted observation model for particle filter based tracking. With an ensemble of region based gradient features this observation model is able to reliably capture the shape of the tracked object. The observation model is adapted to new object and background appearances while tracking. Thus we developed advanced methods to decide when to update the model, or in other words, if the filter is on target or not. We evaluated our approach using the BoBoT1 as well as the PROST2 datasets. <s> BIB004 </s> A survey of datasets for visual tracking <s> The PROST dataset <s> We propose a novel tracking algorithm that robustly tracks the target by finding the state which minimizes uncertainty of the likelihood at current state. The uncertainty of the likelihood is estimated by obtaining the gap between the lower and upper bounds of the likelihood. By minimizing the gap between the two bounds, our method finds the confident and reliable state of the target. In the paper, the state that gives the Minimum Uncertainty Gap (MUG) between likelihood bounds is shown to be more reliable than the state which gives the maximum likelihood only, especially when there are severe illumination changes, occlusions, and pose variations. A rigorous derivation of the lower and upper bounds of the likelihood for the visual tracking problem is provided to address this issue. Additionally, an efficient inference algorithm using Interacting Markov Chain Monte Carlo is presented to find the best state that maximizes the average of the lower and upper bounds of the likelihood and minimizes the gap between two bounds simultaneously. Experimental results demonstrate that our method successfully tracks the target in realistic videos and outperforms conventional tracking methods. <s> BIB005
The Parallel Robust Online Simple Tracking (PROST) dataset [37] was provided in 2010 by the Institute for computer graphics and vision of Graz University of Technology. The dataset contains four sequences (see Fig. 18 15 The Nejhum dataset  . Four of the five grayscale sequences, each one containing an object to track whose shape strongly varies with time results given by different visual trackers are also provided as text files (PROST BIB003 , Fragtrack BIB001 , MILtrack  BIB002 and GRAD BIB004 ). In these sequences, similar appearances of objects as well as partial occlusions and cluttered background Dh Shirt illumination, clutter, shape, view clutter, scale abrupt motion, scale, occlusions shape camera motion, similar appearance . Two video sequences containing highly deformable objects to track as well as cluttered backgrounds problems are addressed. This dataset was used in different works  BIB005 .