Automatic airplane detection in aerial imagery has a variety of applications. Two of the major challenges in this area are variations in scale and direction of the airplanes. In order to solve these challenges, we present a rotation-and-scale invariant airplane proposal generator. This proposal generator is developed based on the symmetric and regular boundaries of airplanes from the top view called symmetric line segments (SLS). Then, the generated proposals are used to train a deep convolutional neural network for removing non-airplane proposals. Since each airplane can have multiple SLS proposals, where some of them are not in the direction of the fuselage, we collect all proposals correspond to one ground truth as a positive bag and the others as the negative instances. To have multiple instance deep learning, we modify the training approach of the network to learn from each positive bag at least one instance as well as all negative instances. Finally, we employ non-maximum suppression to remove duplicate detections. Our experiments on NWPU VHR-10 dataset show that our method is a promising approach for automatic airplane detection in very high resolution images. Moreover, the proposed algorithm can estimate the direction of the airplanes using box-level annotations as an extra achievement.
The boundary of an airplane in top view is quite distinguished from other objects. So, simple shape descriptors can be good features if the boundary of the objects extracted carefully. In @cite_3 some simple geometrical features such as area, perimeter, roundness, and aspect ratio are extracted from the boundaries as the features. Some more meaningful geometrical features are used in @cite_5 . However, accurate boundary extraction is a challenging problem yet. ,cheng2016object Textural features are used more frequently in this field. Histogram of oriented gradients (HOG) was introduced in @cite_42 and used in many airplane detection studies such as @cite_48 @cite_53 @cite_38 . Bag-of-words (BoW) is another useful feature extractor that established by @cite_37 for airplane detection. Gabor filters, Local Binary Patterns (LBP), and Haar-like features are some other common feature extractors that a review of them is collected in @cite_13 .
@cite_38 @cite_37 @cite_48 @cite_53 @cite_42 @cite_3 @cite_5 @cite_13
2108927102 2004134605 1927650470 1533693043
The objective of this work is the detection of object classes, such as airplanes or horses. Instead of using a model based on salient image fragments, we show that object class detection is also possible using only the object's boundary. To this end, we develop a novel learning technique to extract class-discriminative boundary fragments. In addition to their shape, these “codebook” entries also determine the object's centroid (in the manner of [19]). Boosting is used to select discriminative combinations of boundary fragments (weak detectors) to form a strong “Boundary-Fragment-Model” (BFM) detector. The generative aspect of the model is used to determine an approximate segmentation. We demonstrate the following results: (i) the BFM detector is able to represent and detect object classes principally defined by their shape, rather than their appearance; and (ii) in comparison with other published results on several object classes (airplanes, cars-rear, cows) the BFM detector is able to exceed previous performances, and to achieve this with less supervision (such as the number of training images). Motivated by the discriminative ability of shape information and local patterns in object recognition, this paper proposes a window-based object descriptor that integrates both cues. In particular, contour templates representing object shape are used to derive a set of so-called key points at which local appearance features are extracted. These key points are located using an improved template matching method that utilises both spatial and orientation information in a simple and effective way. At each of the extracted key points, a new local appearance feature, namely non-redundant local binary pattern (NR-LBP), is computed. An object descriptor is formed by concatenating the NR-LBP features from all key points to encode the shape as well as the appearance of the object. The proposed descriptor was extensively tested in the task of detecting humans from static images on the commonly used MIT and INRIA datasets. The experimental results have shown that the proposed descriptor can effectively describe non-rigid objects with high articulation and improve the detection rate compared to other state-of-the-art object descriptors. A method for efficient border ownership assignment in 2D images is proposed. Leveraging on recent advances using Structured Random Forests (SRF) for boundary detection [8], we impose a novel border ownership structure that detects both boundaries and border ownership at the same time. Key to this work are features that predict ownership cues from 2D images. To this end, we use several different local cues: shape, spectral properties of boundary patches, and semi-global grouping cues that are indicative of perceived depth. For shape, we use HoG-like descriptors that encode local curvature (convexity and concavity). For spectral properties, such as extremal edges [28], we first learn an orthonormal basis spanned by the top K eigenvectors via PCA over common types of contour tokens [23]. For grouping, we introduce a novel mid-level descriptor that captures patterns near edges and indicates ownership information of the boundary. Experimental results over a subset of the Berkeley Segmentation Dataset (BSDS) [24] and the NYU Depth V2 [34] dataset show that our method's performance exceeds current state-of-the-art multi-stage approaches that use more complex features. Automatic cloud extraction from satellite imagery is an important task for many applications in remote sensing. Humans can easily identify various clouds from satellite images based on the visual features of cloud. In this study, a method of automatic cloud detection is proposed based on object classification of image features. An image is first segmented into superpixels so that the descriptor of each superpixel can be computed to form a feature vector for classification. The support vector machine algorithm is then applied to discriminate cloud and noncloud regions. Thereafter, the GrabCut algorithm is used to extract more accurate cloud regions. The key of the method is to deal with the highly varying patterns of clouds. The bag-of-words (BOW) model is used to construct the compact feature vectors from densely extracted local features, such as dense scale-invariant feature transform (SIFT). The algorithm is tested using 101 RapidEye and 86 Landsat images with many cloud patterns. These images achieve 89.2 of precision, 87.8 of recall for RapidEye, 85.8 of precision, and 83.9 of recall for Landsat. The experiments show that the method is insensitive to the number of codewords in the codebook construction of the BOW.