14419032
Content-based 3D neuroradiologic image retrieval: preliminary results
A content-based 3D neuroradiologic image retrieval system is being developed at the Robotics Institute of CMU. The special characteristics of this system include: directly dealing with multimodal 3D images (MR/CT); image similarity based on anatomical structures of the human brain; and combining both visual and collateral information for indexing and retrieval. A testbed has been implemented for using detected salient visual features for indexing and retrieving 3D images.
1236601
Skewed symmetry groups
We introduce the term skewed symmetry groups and provide a complete theoretical treatment for 2D wallpaper groups under affine transformations. For the first time, a given periodic pattern can be classified not simply by its Euclidean symmetry group but,by its highest "potential" symmetry group under affine deformation. A concise wallpaper group migration map is constructed that separates the 17 affinely deformed wallpaper groups into small, distinct orbits. The practical value of this result includes a novel indexing and retrieval scheme for regular patterns, and a maximal-symmetry-based method for estimating shape and orientation from texture under unknown views.
5064803
Body Localization in Still Images Using Hierarchical Models and Hybrid Search
We present a 3-level hierarchical model for localizing human bodies in still images from arbitrary viewpoints. We first fit a simple tree-structured model defined on a small landmark set along the body contours by Dynamic Programming (DP). The output is a series of proposal maps that encode the probabilities of partial body configurations. Next, we fit a mixture of view-dependent models by Sequential Monte Carlo (SMC), which handles self-occlusion, anthropometric constraints, and large viewpoint changes. DP and SMC are designed to search in opposite directions such that the DP proposals are utilized effectively to initialize and guide the SMC inference. This hybrid strategy of combining deterministic and stochastic search ensures both the robustness and efficiency of DP, and the accuracy of SMC. Finally, we fit an expanded mixture model with increased landmark density through local optimization. The model hierarchy is trained on a large number of gait images. Extensive tests on cluttered images with varying poses including walking, dancing and various types of sports activities demonstrate the feasibility of the proposed approach.
5262963
Texture replacement in real images
Texture replacement in real images has many applications, such as interior design, digital movie making and computer graphics. The goal is to replace some specified texture patterns in an image while preserving lighting effects, shadows and occlusions. To achieve convincing replacement results we have to detect texture patterns and estimate the lighting map from a given image. Near regular planar texture patterns are considered in this paper. Given a sample texture patch, a standard tile is computed. Candidate texture regions are determined by mutual information between the standard tile and each image patch. Regions with high mutual information scores are used to estimate the admissible lighting distributions, which is represented by cached statistics. Spatial lighting change constraints are represented by a Markov random field model. Maximum a posteriori estimation of the texture segmentation and lighting map is solved in a stochastic annealing fashion, namely, the Markov chain Monte Carlo method. Visually satisfactory result is achieved using this statistical sampling model.
122978488
Representation and matching of articulated shapes
We consider the problem of localizing the articulated and deformable shape of a walking person in a single view. We represent the non-rigid 2D body contour by a Bayesian graphical model whose nodes correspond to point positions along the contour. The deformability of the model is constrained by learned priors corresponding to two basic mechanisms: local non-rigid deformation, and rotation motion of the joints. Four types of image cues are combined to relate the model configuration to the observed image, including edge gradient map, foreground/background mask, skin color mask, and appearance consistency constraints. The constructed Bayes network is sparse and chain-like, enabling efficient spatial inference through sequential Monte Carlo sampling methods. We evaluate the performance of the model on images taken in cluttered, outdoor scenes. The utility of each image cue is also empirically explored.
5302961
A Group Theoretic Formalization of Surface Contact
The surface contacts between solids are always associated with a set of symmetries of the contacting surfaces. These symmetries form a group known as the symmetry group of the surface. In this article we develop a group theoretic formalization for describing surface contact between solids. In particular we define (1) primitive and compound features of a solid, (2) a topological characterization of these features, and (3) the symmetry groups of primitive and compound features. The symmetry group of a feature is a descriptor of the fea ture that is at once abstract and quantitative. We show how to use group theory concepts to describe the exact relative motion (position) of solids under surface contacts, which can be either rigid or articulated. The central result of this article is to prove the following: 1. When primitive features of a solid are mutually dis tinct, 1-congruent or 2-congruent, the symmetry group of a compound feature can be expressed in terms of the intersection of the symmetry groups of its primitive features. 2. When two solids have surface contact, their rela tive positions can be expressed as a coset of their common symmetry group, which in turn can be ex pressed in terms of the intersections of the symmetry groups of the primitive features involved in this con tact. These results show that using group theory to formalize surface contacts is a general approach for specifying spatial relationships and forms a sound basis for the automation of robotic task planning. One advantage of this formulation is its ability to express continuous motions between two surface- contacting solids in a computational manner and to avoid combinatorics arising from multiple relationships, especially from discrete symmetries in the assembly parts and their fea tures. At the end of this article, a geometric representation for symmetry groups and an efficient group intersection algorithm using characteristic invariants are described.
15370058
Evolutionary programming made faster
Evolutionary programming (EP) has been applied with success to many numerical and combinatorial optimization problems in recent years. EP has rather slow convergence rates, however, on some function optimization problems. In the paper, a "fast EP" (FEP) is proposed which uses a Cauchy instead of Gaussian mutation as the primary search operator. The relationship between FEP and classical EP (CEP) is similar to that between fast simulated annealing and the classical version. Both analytical and empirical studies have been carried out to evaluate the performance of FEP and CEP for different function optimization problems. The paper shows that FEP is very good at search in a large neighborhood while CEP is better at search in a small local neighborhood. For a suite of 23 benchmark problems, FEP performs much better than CEP for multimodal functions with many local minima while being comparable to CEP in performance for unimodal and multimodal functions with only a few local minima. The paper also shows the relationship between the search step size and the probability of finding a global optimum and thus explains why FEP performs better than CEP on some functions but not on others. In addition, the importance of the neighborhood size and its relationship to the probability of finding a near-optimum is investigated. Based on these analyses, an improved FEP (IFEP) is proposed and tested empirically. This technique mixes different search operators (mutations). The experimental results show that IFEP performs better than or as well as the better of FEP and CEP for most benchmark problems tested.
34130479
Efficient and inefficient ant coverage methods
Ant robots are simple creatures with limited sensing and computational capabilities. They have the advantage that they are easy to program and cheap to build. This makes it feasible to deploy groups of ant robots and take advantage of the resulting fault tolerance and parallelism. We study, both theoretically and in simulation, the behavior of ant robots for one-time or repeated coverage of terrain, as required for lawn mowing, mine sweeping, and surveillance. Ant robots cannot use conventional planning methods due to their limited sensing and computational capabilities. To overcome these limitations, we study navigation methods that are based on real-time (heuristic) search and leave markings in the terrain, similar to what real ants do. These markings can be sensed by all ant robots and allow them to cover terrain even if they do not communicate with each other except via the markings, do not have any kind of memory, do not know the terrain, cannot maintain maps of the terrain, nor plan complete paths. The ant robots do not even need to be localized, which completely eliminates solving difficult and time-consuming localization problems. We study two simple real-time search methods that differ only in how the markings are updated. We show experimentally that both real-time search methods robustly cover terrain even if the ant robots are moved without realizing this (say, by people running into them), some ant robots fail, and some markings get destroyed. Both real-time search methods are algorithmically similar, and our experimental results indicate that their cover time is similar in some terrains. Our analysis is therefore surprising. We show that the cover time of ant robots that use one of the real-time search methods is guaranteed to be polynomial in the number of locations, whereas the cover time of ant robots that use the other real-time search method can be exponential in (the square root of) the number of locations even in simple terrains that correspond to (planar) undirected trees.
18353926
Inverse validation for accurate range image registration with structured data
Automatic range image registration is a fundamental yet extremely difficult problem in machine vision. In this paper, we extend a promising registration algorithm, the geometric iterative closest point (GICP), for structured image data. The extended algorithm is based on a relaxation method combining the motion estimation results from the possible correspondences established by the GICP algorithm and those that are further evaluated by an inverse validation procedure. A comparative study based on real images has shown that the extended algorithm is more accurate and robust than the original algorithm.
36759557
Geometrical analysis of two sets of 3D correspondence data patterns
Given two sets of image correspondence data, the analysis of the corresponding rigid body transformation that accurately describes the object's motion in 3D space is a fundamental problem in image understanding. While many methods have been put forward to analyse 3D transformations, such methods do not make use of the vector distance between feature points and angular information as constraints to analyse transformation parameters. Current methods and algorithms have also suffered from the problems of lack of efficiency, sensitivity to noise, and multiplicity of solutions. In this paper we present a novel geometrical analysis of rigid body transformations and a novel algorithm to calibrate transformation parameters based on image correspondence. The algorithm is validated through experimental calibration and a comparison is made with calibration implemented by the least squares method. We demonstrate that the proposed algorithm works well in the presence of noise and that its performance is in general superior to algorithms based on the least squares method.
18963770
A quasi-Monte Carlo method for computing areas of point-sampled surfaces
A novel and efficient quasi-Monte Carlo method for computing the area of a point-sampled surface with associated surface normal for each point is presented. Our method operates directly on the point cloud without any surface reconstruction procedure. Using the Cauchy-Crofton formula, the area of the point-sampled surface is calculated by counting the number of intersection points between the point cloud and a set of uniformly distributed lines generated with low-discrepancy sequences. Based on a clustering technique, we also propose an effective algorithm for computing the intersection points of a line with the point-sampled surface. By testing on a number of point-based models, experiments suggest that our method is more robust and more efficient than those conventional approaches based on surface reconstruction.