11841640
Accelerating Profile Queries in Elevation Maps
Elevation maps are a widely used spatial data representation in geographical information systems (GIS). Paths on elevation maps can be characterized by profiles, which describe relative elevation as a function of distance. In this research, we address the inverse of this mapping - given a profile, how to efficiently find paths that could have generated it. This is called the profile query problem. Profiles have a wide variety of uses that include registering tracking information, or even other maps, to a given map. We describe a probabilistic model to characterize the maximal likelihood that a point lying on a path matches the query profile. Propagation of such probabilities to neighboring points can effectively prune the search space. This model enables us to efficiently answer queries of arbitrary profiles with user-specified error tolerances. When compared to existing spatial index methods, our approach supports more flexible queries with orders of magnitude speedup.
9189430
Exploring the energy-time tradeoff in MPI programs on a power-scalable cluster
Recently, energy has become an important issue in high-performance computing. For example, supercomputers that have energy in mind, such as BlueGene/L, have been built; the idea is to improve the energy efficiency of nodes. Our approach, which uses off-the-shelf, high-performance cluster nodes that are frequency scalable, allows energy saving by scaling down the CPU. This paper investigates the energy consumption and execution time of applications from a standard benchmark suite (NAS) on a power-scalable cluster. We study via direct measurement and simulation both intra-node and inter-node effects of memory and communication bottlenecks, respectively. Additionally, we compare energy consumption and execution time across different numbers of nodes. Our results show that a power-scalable cluster has the potential to save energy by scaling the processor down to lower energy levels. Furthermore, we found that for some programs, it is possible to both consume less energy and execute in less time when using a larger number of nodes, each at reduced energy. Additionally, we developed and validated a model that enables us to predict the energy-time tradeoff of larger clusters.
268487
Mining non-redundant high order correlations in binary data
Many approaches have been proposed to find correlations in binary data. Usually, these methods focus on pair-wise correlations. In biology applications, it is important to find correlations that involve more than just two features. Moreover, a set of strongly correlated features should be non-redundant in the sense that the correlation is strong only when all the interacting features are considered together. Removing any feature will greatly reduce the correlation.In this paper, we explore the problem of finding non-redundant high order correlations in binary data. The high order correlations are formalized using multi-information, a generalization of pairwise mutual information. To reduce the redundancy, we require any subset of a strongly correlated feature subset to be weakly correlated. Such feature subsets are referred to as Non-redundant Interacting Feature Subsets (NIFS). Finding all NIFSs is computationally challenging, because in addition to enumerating feature combinations, we also need to check all their subsets for redundancy. We study several properties of NIFSs and show that these properties are useful in developing efficient algorithms. We further develop two sets of upper and lower bounds on the correlations, which can be incorporated in the algorithm to prune the search space. A simple and effective pruning strategy based on pair-wise mutual information is also developed to further prune the search space. The efficiency and effectiveness of our approach are demonstrated through extensive experiments on synthetic and real-life datasets.
765245
CARE: Finding Local Linear Correlations in High Dimensional Data
Finding latent patterns in high dimensional data is an important research problem with numerous applications. Existing approaches can be summarized into 3 categories: feature selection, feature transformation (or feature projection) and projected clustering. Being widely used in many applications, these methods aim to capture global patterns and are typically performed in the full feature space. In many emerging biomedical applications, however, scientists are interested in the local latent patterns held by feature subsets, which may be invisible via any global transformation. In this paper, we investigate the problem of finding local linear correlations in high dimensional data. Our goal is to find the latent pattern structures that may exist only in some subspaces. We formalize this problem as finding strongly correlated feature subsets which are supported by a large portion of the data points. Due to the combinatorial nature of the problem and lack of monotonicity of the correlation measurement, it is prohibitively expensive to exhaustively explore the whole search space. In our algorithm, CARE, we utilize spectrum properties and effective heuristic to prune the search space. Extensive experimental results show that our approach is effective in finding local linear correlations that may not be identified by existing methods.
9042204
CRD: fast co-clustering on large datasets utilizing sampling-based matrix decomposition
The problem of simultaneously clustering columns and rows (co-clustering) arises in important applications, such as text data mining, microarray analysis, and recommendation system analysis. Compared with the classical clustering algorithms, co-clustering algorithms have been shown to be more effective in discovering hidden clustering structures in the data matrix. The complexity of previous co-clustering algorithms is usually O(m X n), where m and n are the numbers of rows and columns in the data matrix respectively. This limits their applicability to data matrices involving a large number of columns and rows. Moreover, some huge datasets can not be entirely held in main memory during co-clustering which violates the assumption made by the previous algorithms. In this paper, we propose a general framework for fast co-clustering large datasets, CRD. By utilizing recently developed sampling-based matrix decomposition methods, CRD achieves an execution time linear in m and n. Also, CRD does not require the whole data matrix be in the main memory. We conducted extensive experiments on both real and synthetic data. Compared with previous co-clustering algorithms, CRD achieves competitive accuracy but with much less computational cost.
16446501
Mining frequent closed patterns in microarray data
Microarray data typically contains a large number of columns and a small number of rows, which poses a great challenge for existing frequent (closed) pattern mining algorithms that discover patterns in item enumeration space. In this paper, we propose two algorithms that explore the row enumeration space to mine frequent closed patterns. Several experiments on real-life gene expression data show that the algorithms are faster than existing algorithms, including CLOSET, CHARM, CLOSET+ and CARPENTER.
2696556
Dynamic Modeling of Biotechnical Process Based on Online Support Vector Machine
Due to the complexity and high non-linearity of biotechnical process, most simple mathematical models cannot describe the behavior of biochemistry systems very well. Therefore, dynamic modeling of biotechnical process is indispensable. Support vector machine (SVM) is a novel machine learning method, which is powerful for the problem characterized by small sample, non-linearity, high dimension and local minima, and has high generalization. But currently most support vector machine regression (SVR) training algorithms are offline, which could not be suit for time-variant system. So an improved SVM called online support vector machine was presented to modeling for the dynamic feature of fermentation process. The model based on the modified SVM was developed and demonstrated using simulation experiments. Some models based on SVM were also presented. The result shows that the modeling based online SVM is superior to modeling based on SVW.
24069960
Study of Improved Hierarchy Genetic Algorithm Based on Adaptive Niches
Canonical genetic algorithms have the defects of pre-maturity and stagnation when applied in optimizing problems. In order to avoid the shortcomings, an adaptive niche hierarchy genetic algorithm (ANHGA) is proposed. The algorithm is based on the adaptive mutation operator and crossover operator to adjust the crossover rate and probability of mutation of each individual, whose mutation values are decided using individual gradient. This approach is applied in Percy and Shubert function optimization. Comparisons of niche genetic algorithm (NGA), hierarchy genetic algorithm (HGA) and ANHGA have been done by establishing a simulation model and the results of mathematics model and actual industrial model show that ANHGA is feasible and efficient in the design of multi-extremum.
10141936
Complexity-based rate distortion optimization with perceptual tuning for scalable video coding
This paper has proposed a content adaptive rate-distortion optimization scheme for scalable video coding. To adaptively determine the tradeoff between texture and motion coding, the scheme first makes use of spatial and temporal complexities to adjust the Lagrangian multiplier for all the macroblocks in a frame. After that, the Lagrangian multiplier for every macroblock of the frame is further refined using local perceptual cues. To ensure optimal local selection of the Lagrangian multiplier, several characteristics of human visual system have been taken into account to guide the adjustment. Experiments have shown that the proposed scheme could effectively adapt the adjustment of Lagrangian multiplier to video contents and the subjective quality of the reconstructed frames could be improved without compromising PSNR.
7351388
An ontology of time for the semantic web
In connection with the DAML project for bringing about the Semantic Web, an ontology of time is being developed for describing the temporal content of Web pages and the temporal properties of Web services. This ontology covers topological properties of instants and intervals, measures of duration, and the meanings of clock and calendar terms.
18783473
A multi-objective-based non-stationary UAV assignment model for constraints handling using PSO
An unmanned aerial vehicle (UAV) assignment requires allocating vehicles to destinations to complete various jobs. It is a complex assignment problem with hard constraints, and potential dimensional explosion when the scenarios become more complicated and the size of problems increases. Moreover, the non-stationary UAV assignment problem, studied in the paper, is more difficult, since dynamic scenarios are introduced, e.g. change of the number, or different task requirements of targets and vehicle, etc. In this paper, a "Constraint-First-Objective- Next" model is proposed for the non-stationary problem. The proposed model can effectively handle constraints as an additional objective, including constraints expressed by nature language, and is flexible enough to be combined with kinds of intelligent computation algorithms. A local version of PSO is cooperated with the proposed model to solve non-stationary UAV assignment problems. Numerical experimental results illustrate that it can efficiently achieve the optima and demonstrate the effectiveness.