Music Generation

Music generation is the use of a generative model to compose new music from a text prompt or a reference track: the model learns the statistical patterns of melody, harmony and rhythm from training data and renders new audio, a full mix or editable stems.

Generative AIAI musicgenerative music
§ 01DefinitionMusic Generation

No jargon, no math

In plain words, what is it?

A music model is trained on two kinds of food: scores (notes with timing) and raw audio. From millions of examples it learns the statistics of melody, harmony, rhythm and timbre, not the rules from a textbook. You steer it with a prompt: genre, mood, tempo, instruments, a reference track. In audio models the music is rendered as sound in one pass; in token models it is written as a stream of note tokens, the way a language model writes sentences. What comes out is a full mix or separated stems (drums, bass, melody) you can edit. Where it breaks: long-form structure. Past two or three minutes the model loses the plot and loops. It also inherits the licensing fog of its training data, so for published work you need a platform with clean licences. Its natural habitat is drafts: placeholders, mood sketches, podcast beds. The final cue still wants a human ear.

§ 03

Want this running in your stack?

We design and ship AI systems with permissions, logs and human approval. It starts with a 30-minute scoping call.