16583184
Using cluster skeleton as prototype for data labeling
A new approach, designed for clustering data whose underlying distribution shapes are arbitrary, is presented. This study is concerned with the use of the skeleton of a cluster as its prototype, which can represent the cluster more closely than that of using a single data point. The given data set is then partitioned into those skeleton-represented clusters without any prior knowledge nor assumptions of hidden structures. A novel function called cluster characteristic function (CCF) has been constructed and the associated theorems have been proposed and proved that the proper number of clusters can be determined with the approach.
44509988
A threshold criterion, auto-detection and its use in MST-based clustering
Clustering is to group data points into homogenous clusters so that data points within the same cluster are more similar than data points belonging to different clusters. There are many effective clustering algorithms for discovering arbitrary shaped clusters, but one common problem of many algorithms is the difficulty for users to decide appropriate parameters for these algorithms. To reduce the dependence of clustering performance on parameters, this paper proposes a threshold criterion for the single linkage cluster analysis and incorporates it into the Minimum Spanning Tree (MST) based clustering method. Since the threshold can be automatically decided according to the underlying data distributions, arbitrary shaped clusters can be discovered with little human intervention. The experimental results on spatial data are very encouraging.
207717559
Associative Clustering for Clusters of Arbitrary Distribution Shapes
A novel neural network, named Associative Clustering Neural Network (ACNN), is developed for clustering data whose underlying distribution shapes are arbitrary. ACNN is a dynamic model that collectively measures and updates the similarity of any two patterns through the interaction of a group of patterns. Such a new measure of similarity helps to achieve more robust clustering performance than using the existing measures that are staticly and individually based on the distances among the isolated pairwise data. The efficience of ACNN has been verified through the performance study.
27714693
Efficient Parallel Processing for K-Nearest-Neighbor Search in Spatial Databases
Even though the problem of k nearest neighbor (kNN) query is well-studied in serial environment, there is little prior work on parallel kNN search processing in parallel one. In this paper, we present the first Best-First based Parallel kNN (BFPkNN) query algorithm in a multi-disk setting, for efficient handling of kNN retrieval with arbitrary values of k by parallelization. The core of our method is to access more entries from multiple disks simultaneously and enable several effective pruning heuristics to discard non-qualifying entries. Extensive experiments with real and synthetic datasets confirm that BFPkNN significantly outperforms its competitors in both efficiency and scalability.
18283115
Mining Maximal Frequently Changing Subtree Patterns from XML Documents
Due to the dynamic nature of online information, XML documents typically evolve over time. The change of the data values or structures of an XML document may exhibit some particular patterns. In this paper, we focus on the sequence of changes to the structures of an XML document to find out which subtrees in the XML structure frequently change together, which we call Frequently Changing Subtree Patterns (FCSP). In order to keep the discovered patterns more concise, we further define the problem of mining maximal FCSPs. An algorithm derived from the FP-growth is developed to mine the set of maximal FCSPs. Experiment results show that our algorithm is substantially faster than the naive algorithm and it scales well with respect to the size of the XML structure.
60542101
A novel ant clustering algorithm based on cellular automata
Based on the principle of cellular automata in artificial life, an artificial ant sleeping model (ASM) and an ant algorithm for cluster analysis (A4C) are presented. Inspired by the behaviors of gregarious ant colonies, we use the ant agent to represent a data object. In ASM, each ant has two states: a sleeping state and an active state. The ant's state is controlled by a function of the ant's fitness to the environment it locates and a probability for the ants becoming active. The state of an ant is determined only by its local information. By moving dynamically, the ants form different subgroups adaptively, and hence the data objects they represent are clustered. Experimental results show that the A4C algorithm on ASM is significantly better than other clustering methods in terms of both speed and quality. It is adaptive, robust and efficient, achieving high autonomy, simplicity and efficiency.
7815226
Peak Load Forecasting Using the Self-organizing Map
This paper aims to study the short-term load forecasting of electricity by using an extended self-organizing map. We first adopt a traditional Kohonen self-organizing map (SOM) to learn time-series load data with weather information as parameters. Then, in order to improve the accuracy of the prediction, an extension of SOM algorithm based on error-correction learning rule is used, and the estimation of the peak load is achieved by averaging the output of all the neurons. Finally, as an implementation example, data of electricity demand from New York Independent System Operator (ISO) are used to verify the effectiveness of the learning and prediction for the proposed methods.
21848565
Discrete signal matching using coarse-to-fine wavelet basis functions
In this paper, we propose a matching algorithm to estimate accurate and dense displacements between two signals. The displacements are characterized by a coarse-to-fine wavelet representation, which is a linear combination of hierarchical basis functions developed by Cai and Wang (SIAM Numer. Anal. 33(3) (1996) 937). The coarser-scale basis function has larger support while the finer-scale basis function has smaller support. During the iterative minimization process, the basis functions are utilized as large-to-small windows in selecting global-to-local regions for signal matching. The estimated wavelet coefficients are then used to reconstruct the signal in a coarse-to-fine manner. Two sets of synthetic examples, one with small displacement and the other with large displacements, have been employed to illustrate the advantages of the wavelet-based method. This method has been applied to estimate the dense disparity between stereo images in several real examples and the results demonstrate its effectiveness.