In the task of Autonomous aerial filming of a moving actor (e.g. a person or a vehicle), it is crucial to have a good heading direction estimation for the actor from the visual input. However, the models obtained in other similar tasks, such as pedestrian collision risk analysis and human-robot interaction, are very difficult to generalize to the aerial filming task, because of the difference in data distributions. Towards improving generalization with less amount of labeled data, this paper presents a semi-supervised algorithm for heading direction estimation problem. We utilize temporal continuity as the unsupervised signal to regularize the model and achieve better generalization ability. This semi-supervised algorithm is applied to both training and testing phases, which increases the testing performance by a large margin. We show that by leveraging unlabeled sequences, the amount of labeled data required can be significantly reduced. We also discuss several important details on improving the performance by balancing labeled and unlabeled loss, and making good combinations. Experimental results show that our approach robustly outputs the heading direction for different types of actor. The aesthetic value of the video is also improved in the aerial filming task.
Heading direction estimation is a widely studied problem, in particular focused on humans and cars. One option to tackle the problem is to use inertial and GPS sensors to estimate human's @cite_29 @cite_35 or a car's @cite_7 heading direction. In the context of aerial filming, the target actor generally does not carry extra sensors; thus our emphasis on vision-based solutions in this paper.
@cite_35 @cite_29 @cite_7
2116274755 2519253192 2071626497 2125240024
In this paper we present the uDirect algorithm as a novel approach for mobile phone centric observation of a user's facing direction, through which the device and user orientations relative to earth coordinate are estimated. While the device orientation estimation is based on accelerometer and magnetometer measurements in standing mode, the unique behavior of measured acceleration during stance phase of a human's walking cycle is used for detecting user direction. Furthermore, the algorithm is independent of initial orientation of the device which gives the user higher space of freedom for long term observations. As the algorithm only relies on embedded accelerometer and magnetometer sensors of the mobile phone, it is not susceptible to shadowing effect as GPS. In addition, by performing independent estimations during each step of walking the model is robust to error accumulation. Evaluating the algorithm with 180 data samples from 10 participates has empirically confirmed the assumptions of our analytical model about the unique characteristics of the human stance phase for direction estimation. Moreover, our initial inspection has shown a system based on our algorithm outperforms conventional use of GPS and PCA analysis based techniques for walking distances more than 2 steps. The paper proposes a novel approach for direction estimation of a moving pedestrian as perceived in a 2-D coordinate of field camera. The proposed direction estimation method is intended for pedestrian monitoring in traffic control systems. Apart from traffic control, direction of motion estimation is also very important in accident avoidance system for smart cars, assisted living systems, in occlusion prediction for seamless tracking in visual surveillance, and so on. The proposed video-based direction estimation method exploits the notion of perspective distortion as perceived in monocular vision of 2-D camera co-ordinate. The temporal pattern of change in dimension of pedestrian in a frame sequence is unique for each direction; hence, the dimensional change-based feature is used to estimate the direction of motion; eight discrete directions of motion are considered and the hidden Markov model is used for classification. The experiments are conducted over CASIA Dataset A , CASIA Dataset B , and over a self-acquired dataset: NITR Conscious Walk Dataset . The balanced accuracy of direction estimation for these experiments yields satisfactory results with accuracy indices as 94.58 , 90.87 , and 95.83 , respectively. The experiment also justifies with suitable test conditions about the characteristic features, such as robustness toward improper segmentation, partial occlusion, and changing orientation of head or body during walk of a pedestrian. The proposed method can be used as a standalone system or can be integrated with existing frame-based direction estimation methods for implementing a pedestrian monitoring system. In this paper, we describe a real-time algorithm for computing the ego-motion of a vehicle relative to the road. The algorithm uses as input only those images provided by a single omnidirectional camera mounted on the roof of the vehicle. The front ends of the system are two different trackers. The first one is a homography-based tracker that detects and matches robust scale-invariant features that most likely belong to the ground plane. The second one uses an appearance-based approach and gives high-resolution estimates of the rotation of the vehicle. This planar pose estimation method has been successfully applied to videos from an automotive platform. We give an example of camera trajectory estimated purely from omnidirectional images over a distance of 400 m. For performance evaluation, the estimated path is superimposed onto a satellite image. In the end, we use image mosaicing to obtain a textured 2-D reconstruction of the estimated path. We present a system that estimates the motion of a stereo head, or a single moving camera, based on video input. The system operates in real time with low delay, and the motion estimates are used for navigational purposes. The front end of the system is a feature tracker. Point features are matched between pairs of frames and linked into image trajectories at video rate. Robust estimates of the camera motion are then produced from the feature tracks using a geometric hypothesize-and-test architecture. This generates motion estimates from visual input alone. No prior knowledge of the scene or the motion is necessary. The visual estimates can also be used in conjunction with information from other sources, such as a global positioning system, inertia sensors, wheel encoders, etc. The pose estimation method has been applied successfully to video from aerial, automotive, and handheld platforms. We focus on results obtained with a stereo head mounted on an autonomous ground vehicle. We give examples of camera trajectories estimated in real time purely from images over previously unseen distances (600 m) and periods of time. © 2006 Wiley Periodicals, Inc.