Awesome

ComposerX

Introduction

ComposerX is a multi-agent-based text-to-music generation system powered by GPT where each GPT plays a role in the process of music composition.

This is code for paper "ComposerX: Multi-Agent Symbolic Music Composition with LLMs[here](paper link)

This is our demo page:here

This is out demo video here)

Preparation

Clone this project and install requirements. Download and install MuseScore here and add it to your environment PATH.

Download and install abc2midi here and add it to your environment PATH.

Download AutoGen here: here

Curated prompt set:

eval/prompt_set/prompt_set.json contains the curated prompt set and corresponding musical attributes using self-instruct

Generate your music

Prepare your MuseScore:

python prepare_musescore.py convert_abc_to_wav.py "your local musescore4 path"

Prepare your API:

In music_generation/OAI_CONFIG_LIST, replace the API model and key with your own

For one-time prompt input, run:

python multi_agent_pipe.py -p "input your prompt here" -o "directory to store the results"

For multiple-time prompts input, run:

set_pipe.py -p "path to your JSON file that contains multiple prompts" -o "directory to store the results"

Acknoledgements

We would like to express our gratitude to Multimodal Art Projection(M-A-P) and Hong Kong University of Science and Technology (HKUST) for fund this project.