19371223
Image Enhancement by Kriging and Fuzzy Sets
A kriging method is presented as a spatial filter for smoothing gray-scale images degraded by Gaussian white noise. The concepts are based on the analysis of semivariances, the linear combination scheme of kriging, and fuzzy sets. Application of fuzzy sets allows a gradual transition between two boundaries of semivariance levels as a criterion for smoothing the pixel values. This fuzzy thresholding also allows some degree of flexibility to suit various desired results for particular problems. Experimental results obtained by the fuzzy kriging filter are smoother and still preserve edges compared with those by the adaptive Wiener filter.
10506744
Fusion of Acoustic and Linguistic Features for Emotion Detection
This paper describes a system that deploys acoustic and linguistic information from speech in order to decide whether the utterance contains negative or non-negative meaning. An earlier version of this system was Passed QA to the Interspeech-2009 Emotion Challenge evaluation. The speech data consist of short utterances of the children’s speech, and the proposed system is designed to detect anger in each given chunk. Various frame-based cepstral, prosodic and acoustic features are extracted automatically and classified by means of a support vector machine. An automatic speech recognizer transcribes the utterances and yields a separate classification, based on the degree of emotional salience of the words. The emotionally salient words are computed on word hypotheses, so that un-transcribed training data is sufficient. Late fusion is applied to make a final decision on anger vs. non-anger of the utterance.
5705405
Robust face-voice based speaker identity verification using multilevel fusion
In this paper, we propose a robust multilevel fusion strategy involving cascaded multimodal fusion of audio-lip-face motion, correlation and depth features for biometric person authentication. The proposed approach combines the information from different audio-video based modules, namely: audio-lip motion module, audio-lip correlation module, 2D+3D motion-depth fusion module, and performs a hybrid cascaded fusion in an automatic, unsupervised and adaptive manner, by adapting to the local performance of each module. This is done by taking the output-score based reliability estimates (confidence measures) of each of the module into account. The module weightings are determined automatically such that the reliability measure of the combined scores is maximised. To test the robustness of the proposed approach, the audio and visual speech (mouth) modalities are degraded to emulate various levels of train/test mismatch; employing additive white Gaussian noise for the audio and JPEG compression for the video signals. The results show improved fusion performance for a range of tested levels of audio and video degradation, compared to the individual module performances. Experiments on a 3D stereovision database AVOZES show that, at severe levels of audio and video mismatch, the audio, mouth, 3D face, and tri-module (audio-lip motion, correlation and depth) fusion EERs were 42.9%, 32%, 15%, and 7.3%, respectively, for biometric person authentication task.
43139712
Speaker Verification with Fuzzy Fusion and Genetic Optimization
987011
Similarity normalization for speaker verification by fuzzy fusion
Abstract Similarity or likelihood normalization techniques are important for speaker verification systems as they help to alleviate the variations in the speech signals. In the conventional normalization, the a priori probabilities of the cohort speakers are assumed to be equal. From this standpoint, we apply the theory of fuzzy measure and fuzzy integral to combine the likelihood values of the cohort speakers in which the assumption of equal a priori probabilities is relaxed. This approach replaces the conventional normalization term by the fuzzy integral which acts as a non-linear fusion of the similarity measures of an utterance assigned to the cohort speakers. We illustrate the performance of the proposed approach by testing the speaker verification system with both the conventional and the fuzzy algorithms using the commercial speech corpus TI46. The results in terms of the equal error rates show that the speaker verification system using the fuzzy integral is more flexible and more favorable than the conventional normalization method.
25044094
Generalised Fuzzy Hidden Markov Models for Speech Recognition
A generalised fuzzy approach to statistical modelling techniques for speech recognition is proposed in this paper. Fuzzy C-means (FCM) and fuzzy entropy (FE) techniques are combined into a generalised fuzzy technique and applied to hidden Markov models (HMMs). A more robust version of the above fuzzy technique based on the noise clustering (NC) method is also proposed. Experimental results were performed on the TI46 speech data corpus. A significant result for isolatedword recognition performed on a highly confusable vocabulary consisting of the nine English E-set words is that, a 33.8% recognition error rate for the HMM-based system was reduced to 30.5%, 29.9%, 29.8% and 27.8%, respectively, by using the FCM-HMM, the FE-HMM, the NC-FE-HMM, and the NC-FCM-HMM-based systems.
42894925
Modeling of Context-Aware Self-Adaptive Applications in Ubiquitous and Service-Oriented Environments
Mobile computing in ubiquitous environments has to cope with both predictable and unpredictable changes in the execution context, which introduces the need for context-aware adaptive applications. Such environments are also characterized by dynamically discoverable services that can be utilized by applications to improve their functionality and quality of service (QoS). Thus, application adaptation decisions not only depend on context properties, but also on service availability and QoS-properties. In this chapter we present a novel comprehensive modeling approach that facilitates the model-driven development of such applications. Our focus is on modeling concepts which align the description of services and their QoS-properties with the context modeling approach. We provide a harmonized view on context and service properties, bridging the syntactical and semantic differences through an ontology. We also consider related aspects like semantic service discovery and service level agreements.
26946048
Exploiting Spatial and Temporal Locality of Accesses: A New Hardware-Based Monitoring Approach for DSM Systems
The performance of a parallel system with NUMA characteristics depends on the efficient use of local memory accesses. Programming and tool environments for such DSM systems should enable and exploit data locality.
13891540
MagicMeeting: A Collaborative Tangible Augmented Reality System
We describe an augmented reality (AR) system that allows multiple participants to interact with 2D and 3D data using tangible user interfaces. The system features face-to-face communication, collaborative viewing and manipulation of 3D models, and seamless access to 2D desktop applications within the shared 3D space. All virtual content, including 3D models and 2D desktop windows, is attached to tracked physical objects in order to leverage the efficiencies of natural two-handed manipulation. The presence of 2D desktop space within 3D facilitates data exchange between the two realms, enables control of 3D information by 2D applications, and generally increases productivity by providing access to familiar tools. We present a general concept for a collaborative tangible AR system, including a comprehensive set of interaction techniques, a distributed hardware setup, and a component-based software architecture that can be flexibly configured using XML. We show the validity of our concept with an implementation of an application scenario from the automotive industry.
751960
Performance Evaluation Methodologies for Abstract Data Type Implementation Techniques
Abstract The runtime management system for a programming language must allow the efficient manipulation of complex objects, such as instances of abstract data types (ADTs). We describe an implementation model for ADTs based on coroutine objects (i.e. as an alternative to ad hoc modifications of the runtime stack). We evaluate the performances of variants of our implementation model using two different approaches: a benchmarking technique which monitors actual costs for test programs and a “pseudo-execution” technique which estimates costs based on idealized instruction timings. The results of our comparison indicate that the two forms of evaluation give very similar cost estimates, supporting the use of the (cheaper) pseudo-execution technique. The overall performance results identify applications in which our coroutine implementation model has definite strengths and weaknesses. Finally, our implementation approach is compared with modified stack implementations used in other ADT systems.
6820231
A tangible AR desktop environment
Abstract We present an AR desktop environment which integrates the standard 2D computer desktop into an augmented 3D space. The underlying physical space is given by the standard office desk used in everyday work. Instead of sitting only in front of a computer screen, the user wears a video-through head mounted displays and interacts with the environment in both tangible and virtual ways. In this augmented environment, standard 2D application windows are attached to physical clipboards and can be freely positioned in the working space by simply moving the clipboard. Additionally, 3D content can be brought into and manipulated within the same space. To support interaction with 3D content we have experimented with a circular platform, on which a 3D model can be placed, and which the user can turn in a natural tangible way. By fusing familiar desktop utensils, two-dimensional computer desktop applications, and three-dimensional models, we provide a seamless transition from the traditional 2D computer desktop to a 3D augmented working environment. The paper describes the concept and implementation of the system and illustrates some interfaces and interaction techniques used in the context of CAD engineering.