5764451
Regularized Boost for Semi-Supervised Learning
Semi-supervised inductive learning concerns how to learn a decision rule from a data set containing both labeled and unlabeled data. Several boosting algorithms have been extended to semi-supervised learning with various strategies. To our knowledge, however, none of them takes local smoothness constraints among data into account during ensemble learning. In this paper, we introduce a local smoothness regularizer to semi-supervised boosting algorithms based on the universal optimization framework of margin cost functionals. Our regularizer is applicable to existing semi-supervised boosting algorithms to improve their generalization and speed up their training. Comparative results on synthetic, benchmark and real world tasks demonstrate the effectiveness of our local smoothness regularizer. We discuss relevant issues and relate our regularizer to previous work.
15363041
An Ensemble of Competitive Learning Networks with Different Representations for Temporal Data Clustering
Temporal data clustering provides useful techniques for condensing and summarizing information conveyed in temporal data, which is demanded in various fields ranging from time series analysis to sequential data understanding. In this paper, we propose a novel approach to temporal data clustering by an ensemble of competitive learning networks incorporated by different representations of temporal data. In our approach, competitive learning networks of the rival-penalized learning mechanism are employed for clustering analyses based on different temporal data representations while an optimal selection function is applied to find out a final consensus partition from multiple partition candidates yielded by applying alternative consensus functions to results of competitive learning on different representations. Thanks to its capability of the rival penalized learning rules in automatic model selection and the synergy of fusing diverse partitions on different representations, our ensemble approach yields favorite results, which has been demonstrated in time series and motion trajectory clustering tasks.
52833236
Boosting Input/Output Hidden Markov Models for Sequence Classification
Input/output hidden Markov model (IOHMM) has turned out to be effective in sequential data processing via supervised learning. However, there are several difficulties, e.g. model selection, unexpected local optima and high computational complexity, which hinder an IOHMM from yielding the satisfactory performance in sequence classification. Unlike previous efforts, this paper presents an ensemble learning approach to tackle the aforementioned problems of the IOHMM. As a result, simple IOHMMs of different topological structures are used as base learners in our boosting algorithm and thus an ensemble of simple IOHMMs tend to tackle a complicated sequence classification problem without the need of explicit model selection. Simulation results in text-dependent speaker identification demonstrate the effectiveness of boosted IOHMMs for sequence classification.
15908834
Ensemble Learning with Active Data Selection for Semi-Supervised Pattern Classification
Unlike traditional pattern classification, semi-supervised learning provides a novel technique to make use of both labeled and unlabeled data for improving the performance of classification. In general, there are two critical issues for semi-supervised learning of discriminative classifiers; i.e., how to create an initial classifier of a good generalization capability with the limited labeled data and the how to make an effective use of unlabeled data without degradation of the established classifier. To tackle two aforementioned problems, we propose an ensemble learning approach based on a recent active data selection strategy, where ensemble learning would yield good generalization and active data selection tends to choose the unlabeled data more likely resulting in an improvement during semi-supervised learning. By using an ensemble of K-NN classifiers, we demonstrate the effectiveness of our approach on a synthetic data classification and a facial expression recognition tasks.
17327326
UBM-based incremental speaker adaptation
This paper addresses a novel algorithm of incremental speaker adaptation (ISA) based on universal background model (UBM) for saving storage and real-time processing. This algorithm can be seen as an extension of traditional speaker adaptation. It consists of two steps, adaptation and combination. It not only considers the speaker's characteristics in limited training data, but also prohibits over-fitting of the updated model. The incremental adaptation algorithm needs little storage and meets the requirement of real-time processing. In order to evaluate the efficiency and effectivity of the proposed approach, a real-time speaker segmentation system for broadcasting news is built. Experiment results demonstrate that our approach yields real time operation and achieves satisfactory performance.
32262987
Speaker Modeling with Various Speech Representations
Although numerous speech representations have been reported to be useful in speaker recognition, there is much less agreement on which speech representation provides a perfect representation of speaker-specific information. In this paper, we charaterize a speaker’s identity through the simultaneous use of various speech representations of his/her voice. We present a parametric statistical model, generalized Gaussian mixture model, and develop an EM algorithm for parameter estimation. Our approach has been applied to speaker recognition and comparative results on KING corpus demonstrate its effectiveness.
16063876
How to play a coloring game against a color-blind adversary
We study the problem of conflict-free (CF) coloring of a set of points in the plane, in an online fashion, with respect to halfplanes, nearly-equal axis-parallel rectangles, and congruent disks. As a warm-up exercise, the online CF coloring of points on the line with respect to intervals is also considered. We present randomized algorithms in the oblivious adversary model, where the adversary does not see the colors used. For the problems considered, the algorithms always produce valid CF colorings, and use O(logn) colors with high probability (these bounds are optimal in the worst case). Our randomized online algorithms are considerably simpler than previous algorithms for this problem and use fewer colors.We also present a deterministic algorithm for the CF coloring of points in the plane with respect to nearly-equal axis-parallel rectangles, using O(polylog(n)) colors. This is the first efficient deterministic online CF coloring algorithm for this problem.
22766407
Watermarking Abstract Tree-Structured Data
Digital watermarking techniques have been successfully applied in multimedia data such as image, audio, video, etc. With the rapid development of Internet, the requirement of copyright and integrity protection over semi-structured data, such as XML documents and complex hypertext content, is becoming more and more urgent. However, it is more challenging to apply the effective watermarking schemes into semi-structured data, because watermark for semi-structured data must have the dual protection feature toward both structure and content. In general, most semi-structured data can be represented as tree. Therefore, in this paper, we propose a novel watermark scheme for tree-structured data based on the value lying both in the tree structure and in the node content, which gives a comprehensive protection for both node content and structure of tree. The experiments on the robustness of the solution against various forms of attacks are conducted. The results highlight correctness and efficiency of our solution.
618005
Online conflict-free coloring for halfplanes, congruent disks, and axis-parallel rectangles
We present randomized algorithms for online conflict-free coloring (CF in short) of points in the plane, with respect to halfplanes, congruent disks, and nearly-equal axis-parallel rectangles. In all three cases, the coloring algorithms use O(log n) colors, with high probability.
 We also present a deterministic algorithm for online CF coloring of points in the plane with respect to nearly-equal axis-parallel rectangles, using O(log3n) colors. This is the first efficient (i.e, using polylog(n) colors) deterministic online CF coloring algorithm for this problem.
24158595
A Fractal Watermark Solution for Product Data
Copyright and integrity protection over product data is becoming an urgent requirement, because in a Distributed Networked Manufacturing environment, enterprises have to interact with each other to share product data. In this paper, we introduce a novel watermarking solution for product data based on the idea of fractal, which classifies product data watermarks into three tiers: fractal watermark, tree-structure watermark, and tree-node watermark. It embeds watermarks not only in value-carrying nodes but also in product structures that "glue" all the nodes together by embedding multiple structure watermarks in product data. Simulation results show that the proposed technique is robust against various forms of malicious attacks of product data, and naturally immune from structure transformation attacks and subtractive (sub-tree) attacks. Moreover, the solution can protect tree-structure data whose knowledge is mainly embodied in the tree structure efficiently. It is very easy to implement and popularize.
15163337
A Database Encryption Scheme for Enhanced Security and Easy Sharing
Database encryption is a crucial technique in the security mechanisms of database. It is widely recognized as one of the key issues of data security. Current techniques of sharing the keys and the encrypted data for databases are neither convenient nor flexible in the real applications. Inspired by the PGP technique, we propose a novel database encryption scheme for enhanced data sharing inside a database, while preserving data privacy. It is characterized by both the fast speed of the conventional encryption and the convenience of key distribution of public key encryption. It also provides secured storage for security related data and effective key management, which enables the encrypted data to be shared conveniently. The scheme has been implemented and successfully applied on Oscar, a commercial DBMS developed by us