For human drivers, having rear and side-view mirrors is vital for safe driving. They deliver a more complete view of what is happening around the car. Human drivers also heavily exploit their mental map for navigation. Nonetheless, several methods have been published that learn driving models with only a front-facing camera and without a route planner. This lack of information renders the self-driving task quite intractable. We investigate the problem in a more realistic setting, which consists of a surround-view camera system with eight cameras, a route planner, and a CAN bus reader. In particular, we develop a sensor setup that provides data for a 360-degree view of the area surrounding the vehicle, the driving route to the destination, and low-level driving maneuvers (e.g. steering angle and speed) by human drivers. With such a sensor setup we collect a new driving dataset, covering diverse driving scenarios and varying weather illumination conditions. Finally, we learn a novel driving model by integrating information from the surround-view cameras and the route planner. Two route planners are exploited: 1) by representing the planned routes on OpenStreetMap as a stack of GPS coordinates, and 2) by rendering the planned routes on TomTom Go Mobile and recording the progression into a video. Our experiments show that: 1) 360-degree surround-view cameras help avoid failures made with a single front-view camera, in particular for city driving and intersection scenarios; and 2) route planners help the driving task significantly, especially for steering angle prediction.
While considerable progress has been made both in computer vision and in route planning, their integration for learning driving models has not received due attention in the academic community. A trending topic is to combine digital maps and street-view images for accurate vehicle localization @cite_24 @cite_71 @cite_6 @cite_23 .
@cite_24 @cite_23 @cite_6 @cite_71
2023671107 1985434019 2043732461 2012531858
This paper proposes a method for achieving improved ego-vehicle global localization with respect to an approaching intersection, which is based on the alignment of visual landmarks perceived by the on-board visual system, with the information from a proposed extended digital map (EDM). The visual system relies on a stereovision system that provides a detailed 3-D description of the environment, including road landmark information (lateral lane delimiters, painted traffic signs, curbs, and stop lines) and dynamic environment information (other vehicles). An EDM is proposed, which enriches the standard map information with a detailed description of the intersection required for current lane identification, landmark alignment, and ego-vehicle accurate global localization. A novel approach for lane-delimiter classification, which is necessary for the lane identification, is also presented. An original solution for identifying the current lane, combining visual and map information with the help of a Bayesian network (BN), is proposed. Extensive experiments have been performed, and the results are evaluated with a Global Navigation Satellite System of high accuracy (2 cm). The achieved global localization accuracy is of submeter level, depending on the performance of the stereovision system. Accurate, reliable, and affordable vehicle localization is one important task in current automotive research activities. It enables technologies like cooperative systems or enhanced map based assistance systems. There are a wide variety of approaches to reach this higher accuracy. The algorithm presented in this paper utilizes image landmarks in combination with a low-cost Global Navigation Satellite System (GNSS) receiver and vehicle odometry to achieve this. While similar approaches often extract features from camera images and match those features with map information, the algorithm presented in this work directly transforms map feature data, creating a image of map features, like the camera would see it. The evaluation of this image prediction uses the coherency value, which is derived from the structure tensor. By predicting the whole image, the incorporation of the map information is moved from feature level to signal level. The likelihood models used for the evaluation of the coherency image are derived from real, manually labeled data. We present promising results of a test drive in an area with complex intersections. Those results are compared to ground truth data. In this paper we present a prototype system for image based localization in urban environments. Given a database of views of city street scenes tagged by GPS locations, the system computes the GPS location of a novel query view. We first use a wide-baseline matching technique based on SIFT features to select the closest views in the database. Often due to a large change of viewpoint and presence of repetitive structures, a large percentage of matches (> 50 ) are not correct correspondences. The subsequent motion estimation between the query view and the reference view, is then handled by a novel and efficient robust estimation technique capable of dealing with large percentage of outliers. This stage is also accompanied by a model selection step among the fundamental matrix and the homography. Once the motion between the closest reference views is estimated, the location of the query view is then obtained by triangulation of translation directions. Approximate solutions for cases when triangulation cannot be obtained reliably are also described. The presented system is tested on the dataset used in ICCV 2005 Computer Vision Contest and is shown to have higher accuracy than previous reported results. Digital maps can provide essential information for many advanced driver assistance systems (ADAS) dedicated to both safety and comfort applications. As the level of detail and global accuracy of state-of-the-art digital maps are not sufficient for a multitude of applications, we present methods and models for the generation of high precision maps. The proposed modeling includes 3D lane level information, road markings, landmarks and additional attributes with benefits for many ADAS. The extensive use of circular arc splines enables both adjustable accuracy and high efficiency as our cartographic methodology guarantees the minimum number of curve segments with respect to a given error threshold.