Humans take advantage of real world symmetries for various tasks, yet capturing their superb symmetry perception mechanism into a computational model remains elusive. Encouraged by a new discovery (CVPR 2016) demonstrating extremely high inter-person accuracy of human perceived symmetries in the wild, we have created the first deep-learning neural network for reflection and rotation symmetry detection (Sym-NET), trained on photos from MS-COCO (Common Object in COntext) dataset with nearly 11K symmetry-labels from more than 400 human observers. We employ novel methods to convert discrete human labels into symmetry heatmaps, capture symmetry densely in an image and quantitatively evaluate Sym-NET against multiple existing computer vision algorithms. Using the symmetry competition testsets from CVPR 2013 and unseen MS-COCO photos, Sym-NET comes out as the winner with significantly superior performance over all other competitors. Beyond mathematically well-defined symmetries on a plane, Sym-NET demonstrates abilities to identify viewpoint-varied 3D symmetries, partially occluded symmetrical objects and symmetries at a semantic level.
Pritts al @cite_26 detect reflection, rotation and translation symmetry using SIFT and MSER features. The symmetries are found through non-linear optimization and RANSAC. Tuytelaars al @cite_10 detect reflection through a Cascade Hough Transform. Kiryati and Gofman @cite_28 define a Symmetry ID function implemented through Gaussian windows to find local reflection symmetry.
@cite_28 @cite_26 @cite_10
2060321377 2003233837 1972062985 2276958818
A method for efficient detection of the dominant local reflectional symmetry in grey level images is described. The general approach is to define a local measure of reflectional symmetry that transforms the symmetry detection problem to an optimization problem, and obtain the symmetric regions by an efficient global optimization algorithm. The symmetry of a 1D function can be measured in the frequency domain as the fraction of its energy that resides in symmetric Fourier basis functions. This approach is extended to two dimensions. Locality can be formally treated in terms of the Gabor decomposition and implemented via soft windowing. The resulting measure is a complicated multimodal function of the location of the center of the supporting region, its size, and the orientation of the symmetry axis. A new probabilistic generic algorithm is applied to the determination of the global maximum of the reflectional symmetry function. Less than one thousand evaluations of the local symmetry measure are typically needed in order to locate the dominant symmetry in natural, wildlife test images. Reflection symmetry detection receives increasing attentions in recent years. The state-of-the-art algorithms mainly use the matching of intensity-based features (such as the SIFT) within a single image to find symmetry axes. This paper proposes a novel approach by establishing the correspondence of locally affine invariant edge-based features, which are superior to the intensity based in the aspects that it is insensitive to illumination variations, and applicable to textureless objects. The locally affine invariance is achieved by simple linear algebra for efficient and robust computations, making the algorithm suitable for detections under object distortions like perspective projection. Commonly used edge detectors and a voting process are, respectively, used before and after the edge description and matching steps to form a complete reflection detection pipeline. Experiments are performed using synthetic and real-world images with both multiple and single reflection symmetry axis. The test results are compared with existing algorithms to validate the proposed method. In this paper, a simple and yet robust Hough transform algorithm is proposed to detect and analyze reflectional symmetry and skew-symmetry (reflectional symmetry under parallel projection). It is applicable to shapes that contain global, local and slightly deformed reflectional skew-symmetries under the presence of noise and occlusion. An unsupervised procedure to local symmetry detection in natural images is proposed.Achieved via a Hough-style voting approach made at different scales and coordinate spaces.A final denoising scheme aims at removing noise and spurious local symmetries.Experiments have been conducted on the recent extension of the Berkeley Segmentation Dataset.The proposed method performs well compared to the state-of-the-art algorithms. Display Omitted In this paper, we propose a new unsupervised and simple approach to local symmetry detection of ribbon-like structure in natural images. The proposed model consists in quantifying the presence of a partial medial axis segment, existing between each pair of (preliminary detected) line segments delineating the boundary of two textured regions, by a set of heuristics related both to the geometrical structure of each pair of line segments and its ability to locally delimit a homogeneous texture region in the image. This semi-local approach is finally embedded in a two-step algorithm with an amplification step, via a Hough-style voting approach achieved at different scales and coordinate spaces which aims at determining the dominant local symmetries present in the image and a final denoising step, via an averaging procedure, which aims at removing noise and spurious local symmetries. The experiments, reported in this paper and conducted on the recent extension of the Berkeley Segmentation Dataset for the local symmetry detection task, demonstrate that the proposed symmetry detector performs well compared to the best existing state-of-the-art algorithms recently proposed in the literature.