Led by the success of neural style transfer on visual arts, there has been a rising trend very recently in the effort of music style transfer. However, "music style" is not yet a well-defined concept from a scientific point of view. The difficulty lies in the intrinsic multi-level and multi-modal character of music representation (which is very different from image representation). As a result, depending on their interpretation of "music style", current studies under the category of "music style transfer", are actually solving completely different problems that belong to a variety of sub-fields of Computer Music. Also, a vanilla end-to-end approach, which aims at dealing with all levels of music representation at once by directly adopting the method of image style transfer, leads to poor results. Thus, we see a vital necessity to re-define music style transfer more precisely and scientifically based on the uniqueness of music representation, as well as to connect different aspects of music style transfer with existing well-established sub-fields of computer music studies. Otherwise, an accumulated upcoming literature (all named after music style transfer) will lead to a great confusion of the underlying problems as well as negligence of the treasures in computer music before the age of deep learning. In addition, we discuss the current limitations of music style modeling and its future directions by drawing spirit from some deep generative models, especially the ones using unsupervised learning and disentanglement techniques.
A successful performance style transfer would allow us to transfer Louis Armstrong's interpretation of Summertime to the one of Miles Davis. It is closely related to expressive performance rendering , which studies how to convert static scores into human-like expressive performances by different computational models. @cite_40 @cite_29 @cite_4 The difference is that performance style transfer requires a disentanglement of control (style) and score information (content) and implies that there is room to create new musical expression through the combination of different controls.
@cite_40 @cite_29 @cite_4
2901878846 2627058984 1968754505 1974739246
Artistic style transfer is the problem of synthesizing an image with content similar to a given image and style similar to another. Although recent feed-forward neural networks can generate stylized images in real-time, these models produce a single stylization given a pair of style content images, and the user doesn't have control over the synthesized output. Moreover, the style transfer depends on the hyper-parameters of the model with varying "optimum" for different input images. Therefore, if the stylized output is not appealing to the user, she he has to try multiple models or retrain one with different hyper-parameters to get a favorite stylization. In this paper, we address these issues by proposing a novel method which allows adjustment of crucial hyper-parameters, after the training and in real-time, through a set of manually adjustable parameters. These parameters enable the user to modify the synthesized outputs from the same pair of style content images, in search of a favorite stylized image. Our quantitative and qualitative experiments indicate how adjusting these parameters is comparable to retraining the model with different hyper-parameters. We also demonstrate how these parameters can be randomized to generate results which are diverse but still very similar in style and content. Machine improvisation and related style simulation problems usually consider building repre- sentations of time-based media data, such as music, either by explicit coding of rules or applying machine learning methods. Stylistic learning applies such methods to musical sequences in order to capture salient musical features and organize these features into a model. The Stylistic simulation process browses the model in order to generate variant musical sequences that are stylistically consistent with the learned ma- terial. If both the learning process and the simulation process happen in real-time, in an interactive system where the computer “plays” with musicians, then Machine Improvisation is achieved. Improvisation models have to cope with a trade-off between completeness (all the possible patterns and their continuation laws are discovered) and incrementality (the completeness is ensured only asymptotically for infinite sequences). In a previous work we devised a complete and incremental model based on the Factor Oracle Algorithm. In this paper we propose a concurrent constraints model for the Factor Oracle and show how it can be used in a concurrent learning improvisation situation. Our model is based on a non-deterministic concurrent constraint process calculus (NTCC). Such an approach allows the system to respond in a faster and more flexible manner to real-life performance situations. In addition, the declarative nature of constraints greatly simplifies the expansion of the system with improvisation rules at a higher musical level. We also describe the implementation of our model in a NTCC interpreter written in Common Lisp that is capable of real time performance. Stylistic composition is a creative musical activity, in which students as well as renowned composers write according to the style of another composer or period. We describe and evaluate two computational models of stylistic composition, called Racchman-Oct2010 (random constrained chain of Markovian nodes, October 2010) and Racchmaninof-Oct2010 (Racchman with inheritance of form). The former is a constrained Markov model, and the latter embeds this model in an analogy based design system. Racchmaninof-Oct2010 applies a pattern discovery algorithm called SIACT and a perceptually validated formula for rating pattern importance, to guide the generation of a new target design from an existing source design. A listening study is reported concerning human judgments of music excerpts that are, to varying degrees, in the style of mazurkas by Frederic Chopin (1810–1849). The listening study acts as an evaluation of the two computational models and a third, benchmark system, called Experiments in Musical Intelligence. Judges’ responses indicate that some aspects of musical style, such as phrasing and rhythm, are being modeled effectively by our algorithms. Judgments are also used to identify areas for future improvements. We discuss the broader implications of this work for the fields of engineering and design, where there is potential to make use of our models of hierarchical repetitive structure. Six pianists of varying levels of experience were required to give repeated performances of a note sequence presented for sight-performance under two conditions. The two conditions differed only in the location of metrical stresses signified by the notation. In condition (b) the bar-lines and beams were shifted one note to the right in comparison to condition (a). Details of note duration and intensity were recorded by computer. This allowed the discovery of significant differences in expressive treatment between the two conditions. There were significant agreements between subjects concerning the position, nature and direction of expressive variation. The more experienced players, however, made greater use of expressive variation than did the less experienced players. In a second experiment listeners were asked to identify the metre of each performance from the first experiment. They achieved greatest success at this with the most experienced player, least success with the least experienced player. A det...