1385818
Gestural Interactions for Multi-parameter Audio Control and Audification
This paper presents an interactive multi-modal system for real-time multi-parametric gestural control of audio processing applications. We claim that this can ease the use / control of different tasks and for this we present the following as a demonstration: (1) A musical application, i.e. the multi-parametric control of digital audio effects, and (2) a scientific application, i.e. the interactive navigation of audifications. In the first application we discuss the use of PCA-based control axes and clustering to obtain dimensionality reduced control variables. In the second application we show how the tightly closed human-computer loop actively supports the detection and discovery of features in data under analysis.
10297454
AcouMotion - An Interactive Sonification System for Acoustic Motion Control
This paper introduces AcouMotion as a new hard-/software system for combining human body motion, tangible interfaces and sonification to a closed-loop human computer interface that allows non-visual motor control by using sonification (non-speech auditory displays) as major feedback channel. AcouMotion's main components are (i) a sensor device for measuring motion parameters (ii) a computer simulation to represent the dynamical evolution of a model world, and (iii) a sonification engine which generates an auditory representation of objects and any interactions in the model world. The intended applications of AcouMotion range from new kinds of sport games that can be played without visual displays and therefore may be particularly interesting for people with visual impairment to further applications in data mining, physiotherapy and cognitive research. The first application of AcouMotion presented in this paper is Blindminton, a sport game similar to Badminton which is particularly adapted to the abilities of people with visual impairment. We describe our current system and its state of development, and we present first sound examples for interactive sonification using an early prototype. Finally, we discuss some interesting research directions based on the fact that AcouMotion binds auditory stimuli and body motion, and thus can represent a counterpart to the Eye-tracker device that exploits the binding of visual stimuli and eye-movement in cognitive research.
5682288
Guest Editors' Introduction: An Introduction to Interactive Sonification
The research field of sonification, a subset of the topic of auditory display, has developed rapidly in recent decades. It brings together interests from the areas of data mining, exploratory data analysis, human-computer interfaces, and computer music. Sonification presents information by using sound (particularly nonspeech), so that the user of an auditory display obtains a deeper understanding of the data or processes under investigation by listening.
16705147
Holistic Body Tracking for Gestural Interfaces
In this paper we present an approach to track a moving body in a sequence of camera images by model adaptation. The parameters of a stick figure model are varied by using a stochastic search algorithm. The similarity of rendered model images and camera images of the user are used as quality measure. A refinement of the algorithm is introduced by using combined stereo views and relevance maps to infer responsible joint angles from the difference of successive input images. Finally, the successful application of various versions of the algorithm on sequences of synthetic images is demonstrated.
45319924
Augmented Haptics - An Interactive Feedback System for Musicians
This paper presents integrated vibrotactiles , a novel interface for movement and posture tuition that provides real-time feedback in a tactile form by means of interactive haptic feedback, thereby conveying information neither acoustically nor visually and it is a promising feedback means for movements in 3D-space. In this paper we demonstrate haptic augmentation for applications for musicians, since it (a) doesn't affect the visual sense, occupied by reading music and communication, (b) doesn't disturb in bang sensitive situations such as concerts, (c) allows to relate feedback information in the same tactile medium as the output of the musical instrument, so that an important feedback channel for musical instrument playing is extended and trained supportive. Even more, instructions from the teacher and the computer can be transmitted directly and unobtrusively in this channel. This paper presents a prototype system together with demonstrations of applications that support violinists during musical instrument learning.
2180531
Crystallization sonification of high-dimensional datasets
This paper introduces Crystallization Sonification, a sonification model for exploratory analysis of high-dimensional datasets. The model is designed to provide information about the intrinsic data dimensionality (which is a local feature) and the global data dimensionality, as well as the transitions between a local and global view on a dataset. Furthermore the sound allows to display the clustering in high-dimensional datasets. The model defines a crystal growth process in the high-dimensional data-space which starts at a user selected “condensation nucleus” and incrementally includes neighboring data according to some growth criterion. The sound summarizes the temporal evolution of this crystal growth process. For introducing the model, a simple growth law is used. Other growth laws which are used in the context of hierarchical clustering are also suited and their application in crystallization sonification offers new ways to inspect the results of data clustering as an alternative to dendrogram plots. In this paper, the sonification model is described and example sonifications are presented for some synthetic high-dimensional datasets.
43499978
On higher order derivatives of blending functions
It is well-known that the derivatives of the Bezier curves can be expressed as Bezier curves where the control points are the differences of the original control points. This phenomenon is characterized for finite and infinite function systems.
42092183
Degree elevation for generalized Poisson functions
In this note a common generalization is given for the Bezier and Poisson functions. Further it is proved that the degree elevated control polygon converges to the function.
35470477
A new insight into the Gn continuity of polynomial surfaces
Abstract A theorem of Degen describes the structure of G 1 and G 2 connection between two polynomial surfaces. This is based on common vector polynomials and an irreducibility condition of one of these vector functions related to the common boundary. In this paper Degen's results are reformulated, a new proof and a new interpretation is given which makes it possible to generalize the previous results to G n continuity. Surprisingly, in case of G n continuity, there is no need to add further conditions than for the G 1 G 2 cases, still exists a common G n continuous polynomial virtual patch with polynomial reparametrizations.
23819859
Curve and surface design: H. Hagen (Ed.) SIAM, USA (1992), 219 pp, ISBN 089871-281-5
42941157
On a tolerance problem of parametric curves and surfaces
Abstract This paper gives bounds for the moduli of continuity of parametric curves and surfaces.