a43992899 commited on
Commit
cee3904
1 Parent(s): 115fe99

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -157
README.md CHANGED
@@ -25,14 +25,13 @@ margin. Our work reveals that LLMs can be an excellent compressor for music, but
25
 
26
  <!-- <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/5fd6f670053c8345eddc1b68/8NSONUjIF7KGUCfwzPCd9.mpga"></audio> -->
27
 
28
- ## Prompt Format
29
 
30
  **Our model produces symbolic music(ABC notation) well in the following prompts.** Here are some musical tasks.
31
 
32
  ### Function: Text2music
33
 
34
  ```
35
- Prompt:
36
  Using ABC notation, recreate the given text as a musical score.
37
  Meter C
38
  Notes The parts are commonly interchanged.
@@ -40,173 +39,45 @@ Transcription 1997 by John Chambers
40
  Key D
41
  Note Length 1/8
42
  Rhythm reel
43
-
44
- Response:
45
- X:1
46
- L:1/8
47
- M:2/2
48
- K:D
49
- "A7" FE |"D" D2 FA dAFD |"A7" CDEF G2 FE |"D" D2 FA dcdf |"E7" edcB"A7" AGFE | |"D" D2 FA dAFD |
50
- "A7" CDEF G2 FG |"D" AdcB"A7" AGFE |"D" D2 F2 D2 :: de |"D" fefg fedc |"Em" B^ABc B2 cd |
51
- "E7" e^def e=dcB |"A" A2 ce aABc | |"D" dcde fdAF |"G" GFGA BdcB |"D" AdcB"A7" Agec |
52
- "D" d2 f2 d2 :|
53
  ```
54
  ```
55
- Prompt:
56
  Develop a tune influenced by Bach's compositions.
57
-
58
- Response:
59
- X:1
60
- X:1
61
- T:Music21 Fragment
62
- T:Music21 Fragment
63
- T:Music21
64
- C:Music21
65
- %%score 1 2 3 4
66
- L:1/8
67
- M:4/4
68
- K:C
69
- V:1 treble nm="Piano" snm="Pno"
70
- %%MIDI program 0
71
- %%MIDI control 7 100
72
- %%MIDI control 10 64
73
- L:1/4
74
- V:2 treble nm="Piano" snm="Pno"
75
- %%MIDI channel 3
76
- %%MIDI program 0
77
- %%MIDI control 7 100
78
- %%MIDI control 10 64
79
- V:3 bass nm="Piano" snm="Pno"
80
- %%MIDI channel 4
81
- %%MIDI program 0
82
- %%MIDI control 7 100
83
- %%MIDI control 10 64
84
- V:4 bass nm="Piano" snm="Pno"
85
- %%MIDI channel 5
86
- %%MIDI program 0
87
- %%MIDI control 7 100
88
- %%MIDI control 10 64
89
- V:1
90
- z3 c | B A G F | E D !fermata!E c | d e d c | !fermata!B2 z c | B A G F | E D !fermata!E c | %7
91
- d e d c | !fermata!B2 z e | f e d c | B A !fermata!B B | c d e d | !fermata!c2 z e | d c B A | %14
92
- G A B c | d e d c | !fermata!B2 z e | d c B A | G A B c | d e d c | !fermata!c2 z B | A G F E | %22
93
- D C !fermata!D c | B c d e | d c B A | !fermata!G2 z c | B A G F | E D !fermata!E c | d e d c | %29
94
- !fermata!B2 z e | d c B A | G A B c | d e d c | !fermata!c2 z e | d c B A | G A B c | d e d c | %36
95
- !fermata!c2 z B | A G F E | D C !fermata!D c | B c d e | d c B A | !fermata!G2 z2 |] %42
96
- V:2
97
- z6 CD | EF ED C2 CD | EF ED !fermata!C2 CD | EF GF ED C2 | !fermata!C6 CD | EF ED C2 CD | %6
98
- EF ED !fermata!C2 CD | EF GF ED C2 | !fermata!C6 CD | EF GA GF ED | C2 DE !fermata!F2 DC | %11
99
- B,C DB, C2 CD | !fermata!E6 CD | EF GA GF ED | C2 DE !fermata!F2 DC | B,C DB, C2 CD | %16
100
- !fermata!E6 CD | EF GA GF ED | C2 DE !fermata!F2 DC | B,C DB, C2 CD | !fermata!E6 B,C | %21
101
- DE ^FE D=C B,A, | G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 B,C | DE ^FE D=C B,A, | %26
102
- G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 B,C | DE ^FE D=C B,A, | %30
103
- G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 B,C | DE ^FE D=C B,A, | %34
104
- G,^F, G,2 !fermata!G,2 =F,2 | G,2 A,B, CD EF | !fermata!G6 z2 |] %37
105
- V:3
106
- z6 G,2 | A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 G,2 | %6
107
- A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 G,2 | G,2 A,2 B,2 C2 | %11
108
- C2 B,2 !fermata!C2 B,2 | C2 D2 E2 D2 | !fermata!C6 G,2 | A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | %16
109
- G,2 A,2 B,2 C2 | !fermata!C6 G,2 | G,2 A,2 B,2 C2 | C2 B,2 !fermata!C2 B,2 | C2 D2 E2 D2 | %21
110
- !fermata!C6 B,2 | A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 B,2 | %26
111
- A,2 G,2 G,2 G,2 | G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 B,2 | A,2 G,2 G,2 G,2 | %31
112
- G,2 G,2 !fermata!G,2 G,2 | G,2 A,2 B,2 C2 | !fermata!C6 z2 |] %34
113
- V:4
114
- z6"C" C,2 |"Am" A,,2"Em" E,2"C" C,2"C" C,2 |"Am" A,,2"Em" E,2"C" !fermata!C,2"C" C,2 | %3
115
- "G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"C" C,2 |"Am" A,,2"Em" E,2"C" C,2"C" C,2 | %6
116
- "Am" A,,2"Em" E,2"C" !fermata!C,2"C" C,2 |"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"C" C,2 | %9
117
- "G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" C,2"G" G,,2"C" !fermata!C,2"C" C,2 | %11
118
- "C" C,2"G" G,,2"Am" A,,2"G" B,,2 |"C" !fermata!C,6"C" C,2 |"G" G,,2"Am" A,,2"G" B,,2"C" C,2 | %14
119
- "C" C,2"G" G,,2"C" !fermata!C,2"C" C,2 |"G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"C" C,2 | %17
120
- "G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" C,2"G" G,,2"C" !fermata!C,2"C" C,2 | %19
121
- "G" G,,2"Am" A,,2"G" B,,2"C" C,2 |"C" !fermata!C,6"E" E,2 |"Am" A,,2"Em" E,2"C" C,2"C" C,2 | %
122
  ```
123
 
124
  ### Function: Melody Harmonization
125
 
126
  ```
127
- Prompt:
128
  Construct smooth-flowing chord progressions for the supplied music.
129
 
130
  |: BA | G2 g2"^(C)" edeg | B2 BA"^(D7)" BcBA | G2 g2 edeg | dBAG A2 BA |
131
  G2 g2"^(C)" edeg | B2 BA B2 d2 | e2 ef e2 (3def | gedB A2 :: BA | G2 BG dGBe |
132
  dBBA"^(D7)" B3 A | G2 BG dGBe | dBAG A4 | G2 BG dGBe | dBBA B3 d |
133
  e2 ef e2 (3def | gedB A2 :|
134
-
135
- Response:
136
- X:1
137
- L:1/8
138
- M:2/2
139
- K:G
140
- |: BA |"G" G2 g2"^(C)" edeg |"G" B2 BA"^(D7)" BcBA |"G" G2 g2"Em" edeg |"Am" A2 AG"D7" AcBA |
141
- "G" G2 g2"^(C)" edeg |"G" B2 BA B2 d2 |"C" e2 ef e2 (3def |"D7" gedB A2 :: BA |"G" G2 BG dGBG |
142
- "G" B2 BA"^(D7)" BcBA |"G" G2 BG"Em" dGBG |"Am" A2 AG"D7" AcBA |"G" G2 BG dGBe | dBBA B2 d2 |
143
- "C" e2 ef e2 (3def |"D7" gedB A2 :|
144
  ```
145
  ```
146
- Prompt:
147
  Develop a series of chord pairings that amplify the harmonious elements in the given music piece.
148
 
149
  E |: EAA ABc | Bee e2 d | cBA ABc | BEE E2 D | EAA ABc | Bee e2 d |
150
  cBA ^GAB |1 A2 A A2 E :|2 A2 A GAB || c3 cdc | Bgg g2 ^g | aed cBA |
151
  ^GAB E^F^G | A^GA BAB | cde fed | cBA ^GAB |1 A2 A GAB :|2 \n A3 A2 ||
152
-
153
- Response:
154
- X:1
155
- L:1/8
156
- M:6/8
157
- K:Amin
158
- E |:"Am" EAA ABc |"E7" Bee e2 d |"Am" cBA ABc |"E7" BGE E2 E |
159
- "Am" EAA ABc |"E7" Bee e2 d |"Am" cBA"E7" ^GAB |1"Am" A2 A A2 E :|2
160
- "Am" A2 A GAB ||"C" c3 cdc |"G" Bgg g2 ^g |"Am" aed cBA |
161
- "E7" ^GAB E^F^G |"Am" A^GA"E7" BAB |"Am" cde"Dm" fed |
162
- "Am" cBA"E7" ^GAB |1"Am" A2 A GAB :|2 "Am" A2 A A2 ||
163
  ```
164
 
165
  ### Function: Chord Conditioned Music Generation
166
  ```
167
- Prompt:
168
  Develop a musical piece using the given chord progression. 'Dm', 'C', 'Dm', 'Dm', 'C', 'Dm', 'C', 'Dm'
169
-
170
- Response:
171
- X:1
172
- L:1/8
173
- M:6/8
174
- K:F
175
- z4 z D |"Dm" A2 A"C" G2 F |"Dm" FE D D2 D |
176
- "Dm" A2 A"C" G2 A |"Dm" D3 D2 D |"Dm" A2 A"C" G2 F |
177
- "Dm" FE D D2 D |"Dm" F2 G"C" E2 C |"Dm" D3 D2 D |
178
- "F" F2 F F2 c |"Bb" d2 c"^(Gm)" B2 A |
179
- "Gm" G2 G G2 B |"Am" A2 G"A7" FE D |"Dm" F2 F F2 c |
180
- "Bb" d2 c"^(Gm)" B2 A |"Gm" G2 G"A7" A2 G |
181
- "Dm" FE D D2 z |]
182
  ```
183
 
184
  ### Function: Musical Form Conditioned Music Generation
185
 
186
  ```
187
- Prompt:
188
  Develop a composition by incorporating elements from the given melodic structure.
189
 
190
  Ternary, Sectional: Verse/Chorus/Bridge
191
-
192
- Response:
193
- X:1
194
- L:1/8
195
- M:6/8
196
- K:Gmin
197
- |:"Gm" GAB AG^F | GAB c2 c | d2 d cdB | A2 d cBA |
198
- GAB AG^F | GAB c2 c | d2 d cdB |1 AG^F G2 D :|2
199
- AG^F GAB |: c2 c cBA | c2 c cBA | c2 c cBA |
200
- ABA GAB | c2 c cBA | c2 c cBA | d2 d cdB |1
201
- AG^F GAB :|2 AG^F G2 A |:"Bbm" B3 dcB | f2 e dcB |
202
- c2 f c2 c | cfc cBA | ABB dcB | f2 e dcB |
203
- d2 d edc |1 cBA B2 B :|2 cBA G3 ||
204
  ```
205
 
206
  ### Function: Motif and Form Conditioned Music Generation
207
 
208
  ```
209
- Text Input:
210
  Create music by incorporating the assigned motif into the predetermined musical arrangement.
211
 
212
  Musical Form Input: Only One Section
@@ -217,27 +88,11 @@ L:1/8
217
  M:9/8
218
  K:Emin
219
  vB2 E E2 F G2 A
220
-
221
- Response:
222
- X:1
223
- L:1/8
224
- M:9/8
225
- K:Emin
226
- |:"Em" vB2 E E2 F G2 A |"D" B2 e e2 ^d e3 |
227
- "Bm" B2 E E2 F G2 A |"G" B2 G A2 F"C" G2 E |
228
- "Em" vB2 E E2 F G2 A |"D" B2 e e2 ^d"C" e3 |
229
- "Em" ve2 B"^Av" A2 F"Bm" G2 A |1"G" B2 G"D" A2 F"Em" G2 E :|
230
- 2"G" B2 G"D" A2 F"G" G3 |"^(C)" ABc"^(D)" ded"G" dBG |
231
- "^(C)" cde"D" dcB"G" A2 G |"^(C)" E2 E"Am" ABc"D" def |
232
- "Em" g2 G"D" FAF"G" G3 |"^(C)" ABc"^(D)" ded"G" dBG |
233
- "^(C)" cde"D" dcB"G" A2 G |"Em" e2 B"^Av" A2 F"Bm" G2 A |
234
- "G" B2 G"D" A2 F"Em" G2 E |]
235
  ```
236
 
237
  ### Function: Music Understanding
238
 
239
  ```
240
- Prompt:
241
  Investigate the aspects of this musical work and convey its structural organization using suitable musical words.
242
 
243
  X:1
@@ -254,13 +109,9 @@ G2 dc BAGB | ABcd efge |1 aged cAFA :|2 aged ^cdef |:
254
  g2 af g2 ef | gedc BAGB | Aaag ageg | aged ^cdef |
255
  gbaf g2 ef | gedc BAGB | ABcd efge |1
256
  aged ^cdef :|2 aged cAFA ||
257
-
258
- Response:
259
- Compound Binary
260
  ```
261
 
262
  ```
263
- Prompt:
264
  Analyze the musical work and pinpoint the consistent melodic element in every section.
265
 
266
  X:1
@@ -271,13 +122,6 @@ ge | d2 G2 cBAG | d2 G2 cBAG | e2 A2 ABcd | edcB A2 Bc |
271
  d2 cB g2 fe | edcB cBAG | BAGE DEGA | B2 G2 G2 :: ga |
272
  b2 gb a2 fa | g2 eg edcB | e2 A2 ABcd | edcB A2 ga |
273
  b2 gb a2 fa | g2 eg edcB | cBAG DEGA | B2 G2 G2 :|
274
-
275
- Response:
276
- X:1
277
- L:1/8
278
- M:4/4
279
- K:G
280
- ge d2 G2 cBAG d2 G2 cBAG
281
  ```
282
 
283
  ## Training Data
 
25
 
26
  <!-- <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/5fd6f670053c8345eddc1b68/8NSONUjIF7KGUCfwzPCd9.mpga"></audio> -->
27
 
28
+ ## Example Prompts
29
 
30
  **Our model produces symbolic music(ABC notation) well in the following prompts.** Here are some musical tasks.
31
 
32
  ### Function: Text2music
33
 
34
  ```
 
35
  Using ABC notation, recreate the given text as a musical score.
36
  Meter C
37
  Notes The parts are commonly interchanged.
 
39
  Key D
40
  Note Length 1/8
41
  Rhythm reel
 
 
 
 
 
 
 
 
 
 
42
  ```
43
  ```
 
44
  Develop a tune influenced by Bach's compositions.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
45
  ```
46
 
47
  ### Function: Melody Harmonization
48
 
49
  ```
 
50
  Construct smooth-flowing chord progressions for the supplied music.
51
 
52
  |: BA | G2 g2"^(C)" edeg | B2 BA"^(D7)" BcBA | G2 g2 edeg | dBAG A2 BA |
53
  G2 g2"^(C)" edeg | B2 BA B2 d2 | e2 ef e2 (3def | gedB A2 :: BA | G2 BG dGBe |
54
  dBBA"^(D7)" B3 A | G2 BG dGBe | dBAG A4 | G2 BG dGBe | dBBA B3 d |
55
  e2 ef e2 (3def | gedB A2 :|
 
 
 
 
 
 
 
 
 
 
56
  ```
57
  ```
 
58
  Develop a series of chord pairings that amplify the harmonious elements in the given music piece.
59
 
60
  E |: EAA ABc | Bee e2 d | cBA ABc | BEE E2 D | EAA ABc | Bee e2 d |
61
  cBA ^GAB |1 A2 A A2 E :|2 A2 A GAB || c3 cdc | Bgg g2 ^g | aed cBA |
62
  ^GAB E^F^G | A^GA BAB | cde fed | cBA ^GAB |1 A2 A GAB :|2 \n A3 A2 ||
 
 
 
 
 
 
 
 
 
 
 
63
  ```
64
 
65
  ### Function: Chord Conditioned Music Generation
66
  ```
 
67
  Develop a musical piece using the given chord progression. 'Dm', 'C', 'Dm', 'Dm', 'C', 'Dm', 'C', 'Dm'
 
 
 
 
 
 
 
 
 
 
 
 
 
68
  ```
69
 
70
  ### Function: Musical Form Conditioned Music Generation
71
 
72
  ```
 
73
  Develop a composition by incorporating elements from the given melodic structure.
74
 
75
  Ternary, Sectional: Verse/Chorus/Bridge
 
 
 
 
 
 
 
 
 
 
 
 
 
76
  ```
77
 
78
  ### Function: Motif and Form Conditioned Music Generation
79
 
80
  ```
 
81
  Create music by incorporating the assigned motif into the predetermined musical arrangement.
82
 
83
  Musical Form Input: Only One Section
 
88
  M:9/8
89
  K:Emin
90
  vB2 E E2 F G2 A
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
91
  ```
92
 
93
  ### Function: Music Understanding
94
 
95
  ```
 
96
  Investigate the aspects of this musical work and convey its structural organization using suitable musical words.
97
 
98
  X:1
 
109
  g2 af g2 ef | gedc BAGB | Aaag ageg | aged ^cdef |
110
  gbaf g2 ef | gedc BAGB | ABcd efge |1
111
  aged ^cdef :|2 aged cAFA ||
 
 
 
112
  ```
113
 
114
  ```
 
115
  Analyze the musical work and pinpoint the consistent melodic element in every section.
116
 
117
  X:1
 
122
  d2 cB g2 fe | edcB cBAG | BAGE DEGA | B2 G2 G2 :: ga |
123
  b2 gb a2 fa | g2 eg edcB | e2 A2 ABcd | edcB A2 ga |
124
  b2 gb a2 fa | g2 eg edcB | cBAG DEGA | B2 G2 G2 :|
 
 
 
 
 
 
 
125
  ```
126
 
127
  ## Training Data