Research in texture recognition often concentrates on recognizing textures with intraclass variations, such as illumination, rotation, viewpoint, and small-scale changes. In contrast, in real-world applications, a change in scale can have a dramatic impact on texture appearance to the point of changing completely from one texture category to another. As a result, texture variations due to changes in scale are among the hardest to handle. In this paper, we conduct the first study of classifying textures with extreme variations in scale. To address this issue, we first propose and then reduce scale proposals on the basis of dominant texture patterns. Motivated by the challenges posed by this problem, we propose a new GANet network where we use a genetic algorithm to change the filters in the hidden layers during network training in order to promote the learning of more informative semantic texture patterns. Finally, we adopt a Fisher vector pooling of a convolutional neural network filter bank feature encoder for global texture representation. Because extreme scale variations are not necessarily present in most standard texture databases, to support the proposed extreme-scale aspects of texture understanding, we are developing a new dataset, the extreme scale variation textures (ESVaT) , to test the performance of our framework. It is demonstrated that the proposed framework significantly outperforms the gold-standard texture features by more than 10 on ESVaT. We also test the performance of our proposed approach on the KTHTIPS2b and OS datasets and a further dataset synthetically derived from Forrest, showing the superior performance compared with the state-of-the-art.
The approach in this work is related to the texel size or texture scale. Lindeberg @cite_23 investigated scale for texture description, suggesting that texture characteristics strongly depend upon it. Mirmehdi and Petrou @cite_7 discussed scale variations in real scenes and used them for the segmentation of color textures. There is recent work focusing on the estimation of the local or global scale of textured images without explicitly extracting texture texels @cite_22 @cite_28 . To search the scale proposals of a given texture image, we adopt the binarized normed gradients (BING) algorithm @cite_25 , which has been shown to be very efficient and powerful in proposing local salient regions.
@cite_22 @cite_7 @cite_28 @cite_23 @cite_25
2100902416 2158592854 2157121948 2101789519
Given an arbitrary image, our goal is to segment all distinct texture subimages. This is done by discovering distinct, cohesive groups of spatially repeating patterns, called texels, in the image, where each group defines the corresponding texture. Texels occupy image regions, whose photometric, geometric, structural, and spatial-layout properties are samples from an unknown pdf. If the image contains texture, by definition, the image will also contain a large number of statistically similar texels. This, in turn, will give rise to modes in the pdf of region properties. Texture segmentation can thus be formulated as identifying modes of this pdf. To this end, first, we use a low-level, multiscale segmentation to extract image regions at all scales present. Then, we use the meanshift with a new, variable-bandwidth, hierarchical kernel to identify modes of the pdf defined over the extracted hierarchy of image regions. The hierarchical kernel is aimed at capturing texel substructure. Experiments demonstrate that accounting for the structural properties of texels is critical for texture segmentation, leading to competitive performance vs. the state of the art. This paper presents a novel texture synthesis scheme for anisotropic 2D textures based on perspective feature analysis and energy optimization. Given an example texture, the synthesis process starts with analyzing the texel (TEXture ELement) scale variations to obtain the perspective map (scale map). Feature mask and simple user-assisted scale extraction operations including slant and tilt angles assignment and scale value editing are applied. The scale map represents the global variations of the texel scales in the sample texture. Then, we extend 2D texture optimization techniques to synthesize these kinds of perspectively featured textures. The non-parametric texture optimization approach is integrated with histogram matching, which forces the global statics of the texel scale variations of the synthesized texture to match those of the example. We also demonstrate that our method is well-suited for image completion of a perspectively featured texture region in a digital photo. This paper investigates variational region-level criterion for supervised and unsupervised texture-based image segmentation. The focus is given to the demonstration of the effectiveness and robustness of this region-based formulation compared to most common variational approaches. The main contributions of this global criterion are twofold. First, the proposed methods circumvent a major problem related to classical texture based segmentation approaches. Existing methods, even if they use different and various texture features, are mainly stated as the optimization of a criterion evaluating punctual pixel likelihoods or similarity measure computed within a local neighborhood. These approaches require sufficient dissimilarity between the considered texture features. An additional limitation is the choice of the neighborhood size and shape. These two parameters and especially the neighborhood size significantly influence the classification performances: the neighborhood must be large enough to capture texture structures and small enough to guarantee segmentation accuracy. These parameters are often set experimentally. These limitations are mitigated with the proposed variational methods stated at the region-level. It resorts to an energy criterion defined on image where regions are characterized by nonparametric distributions of their responses to a set of filters. In the supervised case, the segmentation algorithm consists in the minimization of a similarity measure between region-level statistics and texture prototypes and a boundary based functional that imposes smoothness and regularity on region boundaries. In the unsupervised case, the data-driven term involves the maximization of the dissimilarity between regions. The proposed similarity measure is generic and permits optimally fusing various types of texture features. It is defined as a weighted sum of Kullback-Leibler divergences between feature distributions. The optimization of the proposed variational criteria is carried out using a level-set formulation. The effectiveness and the robustness of this formulation at region-level, compared to classical active contour methods, are evaluated for various Brodatz and natural images. In this paper, we present an efficient approach for unsupervised segmenta- tion of natural and textural images based on the extraction o fi mage features and a fast active contour segmentation model. We address the problem of textures where neither the gray-level information nor the boundary information is adequate for object extraction. This is often the case of natural images compose do f both homogeneous and textured regions. Because these images cannot be in generaldirectly processed by the gray-level information, we propose a new texture descripto rw hich intrinsically def ines the geometry of textures using semi-local image informatio na nd tools from differen- tial geometry. Then, we use the popular Kullback-Leibler distance to design an active contour model which distinguishes the background and textures of interest. The exis- tence of a minimizing solution to the proposed segmentationmodel is proven. Finally, at exture segmentation algorithm based on the Split-Bregma nm ethod is introduced to extract meaningful objects in a fast way. Promising synthetic and real-world results for gray-scale and color images are presented.