125908908
The minimum description length principle in coding and modeling (invited paper)
12165073
On the Convergence of Boosting Procedures
A boosting algorithm seeks to minimize empirically a loss function in a greedy fashion. The resulted estimator takes an additive function form and is built iteratively by applying a base estimator (or learner) to updated samples depending on the previous iterations. This paper studies convergence of boosting when it is carried out over the linear span of a family of basis functions. For general loss functions, we prove the convergence of boosting's greedy optimization to the infinimum of the loss function over the linear span. As a side product, these results reveal the importance of restricting the greedy search step sizes, as known in practice through the works of Friedman and others.
828878
Image denoising via lossy compression and wavelet thresholding
Some past work has proposed to use lossy compression to remove noise, based on the rationale that a reasonable compression method retains the dominant signal features more than the randomness of the noise. Building on this theme, we explain why compression (via coefficient quantization) is appropriate for filtering noise from signal by making the connection that quantization of transform coefficients approximates the operation of wavelet thresholding for denoising. That is, denoising is mainly due to the zero-zone and that the full precision of the thresholded coefficients is of secondary importance. The method of quantization is facilitated by a criterion similar to Rissanen's minimum description length principle. An important issue is the threshold value of the zero-zone (and of wavelet thresholding). For a natural image, it has been observed that its subband coefficients can be well modeled by a Laplacian distribution. With this assumption, we derive a threshold which is easy to compute and is intuitive. Experiments show that the proposed threshold performs close to optimal thresholding.
2105049
Model Selection in Gaussian Graphical Models: High-Dimensional Consistency of l1-regularized MLE
We consider the problem of estimating the graph structure associated with a Gaussian Markov random field (GMRF) from i.i.d. samples. We study the performance of study the performance of thel1-regularized maximum likelihood estimator in the high-dimensional setting, where the number of nodes in the graph p, the number of edges in the graph s and the maximum node degree d, are allowed to grow as a function of the number of samples n. Our main result provides sufficient conditions on (n, p, d) for thel1-regularized MLE estimator to recover all the edges of the graph with high probability. Under some conditions on the model covariance, we show that model selection can be achieved for sample sizes n = Ω(d log(p)), with the error decaying as O(exp(−c log(p))) for some constant c. We illustrate our theoretical results via simulations and show good correspondences between the theoretical predictions and behavior in simulations.
6762008
Perceptual audio coding using adaptive pre- and post-filters and lossless compression
This paper proposes a versatile perceptual audio coding method that achieves high compression ratios and is capable of low encoding/decoding delay. It accommodates a variety of source signals (including both music and speech) with different sampling rates. It is based on separating irrelevance and redundancy reductions into independent functional units. This contrasts traditional audio coding where both are integrated within the same subband decomposition. The separation allows for the independent optimization of the irrelevance and redundancy reduction units. For both reductions, we rely on adaptive filtering and predictive coding as much as possible to minimize the delay. A psycho-acoustically controlled adaptive linear filter is used for the irrelevance reduction, and the redundancy reduction is carried out by a predictive lossless coding scheme, which is termed weighted cascaded least mean squared (WCLMS) method. Experiments are carried out on a database of moderate size which contains mono-signals of different sampling rates and varying nature (music, speech, or mixed). They show that the proposed WCLMS lossless coder outperforms other competing lossless coders in terms of compression ratios and delay, as applied to the pre-filtered signal. Moreover, a subjective listening test of the combined pre-filter/lossless coder and a state-of-the-art perceptual audio coder (PAC) shows that the new method achieves a comparable compression ratio and audio quality with a lower delay.
116839195
Some results on empirical processes and stochastic complexity
This thesis contains two parts. In Part I, an intuitive and simple approach is used to obtain uniform convergence and Central Limit Theorems for empirical processes indexed by families of functions, for stationary mixing sequences with not too slow a $\beta$-mixing (or $\phi$-mixing) rate. The conditions imposed are in terms of random metric entropies, and the $\beta$-mixing (or $\phi$-mixing) rate. In the case of a Vapnik-Cervonenkis class, the uniform convergence result holds for any strictly stationary sequence with $\beta$-mixing (or $\phi$-mixing) rate $\beta\sb{n}$ (or $\phi\sb{n}$) = $o$($n\sp{-d}$) for some d $>$ 0, while the Central Limit Theorem requires the rate $\beta\sb{n}$ (or $\phi\sb{n}$ = $o$($n\sp{-d}$) for some d $>$ 3. 
In Part II, we use a shortest code length criterion to select the bin width of a histo-gram from a string of i.i.d. observations. Under smoothness conditions on the underlying density on (0, 1), this criterion is shown to be optimal as a code selection criterion in reaching the smallest redundancy within the class of codes under consideration. Furthermore, the criterion consistently selects the underlying density when it is uniform on (0, 1). 
Minimax lower bounds for the redundancy over many smooth families of underlying densities are also derived. In a special case, the lower bound is shown to be achieved almost surely, and in expectation, by a predictive code based on a sequence of histograms. In the case of Sobolev balls, the minimax optimal code is described and a heuristic proof is provided.
40810024
Page segmentation using document model
Transforming a paper document to its electronic version in a form suitable for efficient storage, retrieval and interpretation continues to be a challenging problem. An efficient document model is necessary to solve this problem. Document modeling involves techniques of thresholding, skew detection, geometric layout analysis and logical layout analysis. The derived model can then be used in document storage and retrieval. We use the traditional bottom-up approach based on the connected component extraction to efficiently implement page segmentation and region identification. A new document model which preserves top-down generation information is proposed based on which a document is logically represented for interactive editing, storage, retrieval, transfer and logical analysis.
42842563
A WSRF Based Shopping Cart System
Web Services Resource Framework (WSRF) is a set of specifications that represents a convergence point of the Web services and the Grid services communities. This paper presents our early experience with WSRF. A shopping cart system has been implemented with WSRF supported Globus toolkit 3.9.2 (GT3.9.2). Based on the system, the performance of the WSRF core in GT3.9.2 has also been evaluated.
15046055
Transform from Models to Service Description Based on MDA
Within MDA framework, system models can be built up on an abstract level that is independent from the platform. Later on, this abstract model can be transmitted into service description, which is related to specific platform on the implementation level. In Web services applications, this transition has a great advantage. Because, while the model of implementation changes from one case to another to fit the different platforms, the model of whole system, on a higher abstract level, stays the same. Thus, the efficiency is promoted. This paper firstly discusses the extension of UML for Web services, and then it presents the modeling process of WSDL. Finally, it gives the rules and arithmetic of transition from models to WSDL documents in detail
677559
TEEVE: the next generation architecture for tele-immersive environments
Tele-immersive 3D multi-camera room environments are starting to emerge and with them new challenging research questions. One important question is how to organize the large amount of visual data, being captured, processed, transmitted and displayed, and their corresponding resources, over current COTS computing and networking infrastructures so that "everybody" would be able to install and use tele-immersive environments for conferencing and other activities. In this paper, we propose a novel cross-layer control and streaming framework over general purpose delivery infrastructure, called TEEVE (tele-immersive environments for everybody). TEEVE aims for effective and adaptive coordination, synchronization, and soft QoS-enabled delivery of tele-immersive visual streams to remote room(s). The TEEVE experiments between two tele-immersive rooms residing in different institutions more than 2000 miles apart show that we can sustain communication of up to 12 3D video streams with 4/spl sim/5 3D frames per second for each stream, yielding 4/spl sim/5 tele-immersive video rate.
11424736
Extending the ONESAF Testbed into a C4ISR Testbed
This article describes how the modeling and simulation environment of the OneSAF Testbed Baseline (OTB) v1.0 has been extended to enable the testing of heterogeneous algorithms that are being designed for real-world C4ISR applications. This has been accomplished by building an architecture that extends functional and logical components of the OTB system in the following ways: the use of the OTB Compact Terrain Database for terrain analysis and preliminary threat assessment, the addition of the RETSINA-OTB Bridge for the real-time query and control of OTB entities, and the addition of new DIS-based sensor entities for interoperation with Command and Control algorithms, to name a few. This article illustrates how to make a few small but general extensions to a modeling and simulation system to create a larger testbed system with minimum impact on the native system and with great potential for the range of applications that can exploit it.