A system for live high quality surface reconstruction using a single moving depth camera on a commodity hardware is presented. High accuracy and real-time frame rate is achieved by utilizing graphics hardware computing capabilities via OpenCL and by using sparse data structure for volumetric surface representation. Depth sensor pose is estimated by combining serial texture registration algorithm with iterative closest points algorithm (ICP) aligning obtained depth map to the estimated scene model. Aligned surface is then fused into the scene. Kalman filter is used to improve fusion quality. Truncated signed distance function (TSDF) stored as block-based sparse buffer is used to represent surface. Use of sparse data structure greatly increases accuracy of scanned surfaces and maximum scanning area. Traditional GPU implementation of volumetric rendering and fusion algorithms were modified to exploit sparsity to achieve desired performance. Incorporation of texture registration for sensor pose estimation and Kalman filter for measurement integration improved accuracy and robustness of scanning process.
With the rise of computation power real-time implementation of the costly fusion step become practicable @cite_13 . Performing fusion in real-time decreases the time necessary to obtain high quality model, simplifies and pleases scanning process for the user, improves the registration quality.
@cite_13
1980529480 2336961836 2568868599 2089254731
Data fusion is a process dealing with the association, correlation, and combination of data and information from multiple sources to achieve refined position and identity estimates. We consider the registration problem, which is a prerequisite process of a data fusion system to accurately estimate and correct systematic errors. An exact maximum likelihood (EML) algorithm for registration is presented. The algorithm is implemented using a recursive two-step optimization that involves a modified Gauss-Newton procedure to ensure fast convergence. Statistical performance of the algorithm is also investigated, including its consistency and efficiency discussions. In particular, the explicit formulas for both the asymptotic covariance and the Cramer-Rao bound (CRB) are derived. Finally, simulated and real-life multiple radar data are used to evaluate the performance of the proposed algorithm. Real-time, high-quality, 3D scanning of large-scale scenes is key to mixed reality and robotic applications. However, scalability brings challenges of drift in pose estimation, introducing significant errors in the accumulated model. Approaches often require hours of offline processing to globally correct model errors. Recent online methods demonstrate compelling results but suffer from (1) needing minutes to perform online correction, preventing true real-time use; (2) brittle frame-to-frame (or frame-to-model) pose estimation, resulting in many tracking failures; or (3) supporting only unstructured point-based representations, which limit scan quality and applicability. We systematically address these issues with a novel, real-time, end-to-end reconstruction framework. At its core is a robust pose estimation strategy, optimizing per frame for a global set of camera poses by considering the complete history of RGB-D input with an efficient hierarchical approach. We remove the heavy reliance on temporal tracking and continually localize to the globally optimized frames instead. We contribute a parallelizable optimization framework, which employs correspondences based on sparse features and dense geometric and photometric matching. Our approach estimates globally optimized (i.e., bundle adjusted) poses in real time, supports robust tracking with recovery from gross tracking failures (i.e., relocalization), and re-estimates the 3D model in real time to ensure global consistency, all within a single framework. Our approach outperforms state-of-the-art online systems with quality on par to offline methods, but with unprecedented speed and scan completeness. Our framework leads to a comprehensive online scanning solution for large indoor environments, enabling ease of use and high-quality results.1 In data-intensive real-time embedded applications, it is desirable to process data service requests in a timely manner using fresh data, consuming less power. However, related work is relatively scarce. In this paper, we present an effective approach to decrease both the deadline miss ratio and power consumption by merging similar real-time transactions, while systematically adapting the data freshness. In a simulation study, our approach considerably reduces deadline misses and power consumptions compared to the state-of-the-art baselines, supporting the required data freshness. Registration is a prerequisite for fusion of geometrically distorted images. Traditionally, intensity-based image registration methods are preferred to feature-based ones due to higher accuracy of the former than that of the latter. To reduce computational load, image registration is often carried out using the approximate-level coefficients of a wavelet-like transform. Directional selectivity of the transform and the objective function used for the coefficients play vital roles in the alignment process of images. This paper introduces an image registration algorithm that uses the approximate-level coefficients of the curvelet transform, directional selectivity of which is better than many wavelet-like transforms. A conditional entropy-based objective function is developed for registration using a suitable probabilistic model of the curvelet coefficients of images. Suitability of the probability distribution of the coefficients is validated using a standard method to assess goodness of fit. To align the distorted images, the affine transformation that possesses parameters related to the translation, rotation, scaling, and shearing is used. Extensive experimentations are carried out to test the performance of the proposed registration method considering that the images are synthetically or naturally distorted. Experimental results show that performance of the proposed registration method is superior to existing methods in terms of commonly used performance metrics.