Home

Awesome

TS-BSMAMBA2: A Two-Stage Band-Split Mamba-2 Network For Music Separation <br>

The paper is available at https://arxiv.org/abs/2409.06245

Abstract

Music source separation (MSS) aims to separate mixed music into its distinct tracks, such as vocals, bass, drums, and more. MSS is considered to be a challenging audio separation task due to the complexity of music signals. Although the RNN and Transformer architecture are not perfect, they are commonly used to model the music sequence for MSS. Recently, Mamba-2 has already demonstrated high efficiency in various sequential modeling tasks, but its superiority has not been investigated in MSS. This paper applies Mamba-2 with a twostage strategy, which introduces residual mapping based on the mask method, effectively compensating for the details absent in the mask and further improving separation performance. Experiments confirm the superiority of bidirectional Mamba2 and the effectiveness of the two-stage network in MSS.

Performance

<p align="center"> <img width="938" alt="image" src="https://github.com/user-attachments/assets/6d10038f-86bb-40e3-9622-820b6f2a77f4"> </p> <p align="center"> <img width="515" alt="image" src="https://github.com/user-attachments/assets/44fd91a7-676f-487b-80b7-230e3b60f82b"> </p>

Usage

TS-BSMAMBA2:

python TS-BSmamba2.py

L-TS-BSMAMBA2 (Lightweight model):

python L-TS-BSmamba2.py

Audio Samples-- Arise - Run Run Run

You can download them using the following link.</br> https://mega.nz/folder/qYBzXL7S#c0qBxQss-PxPue27YqCdfA</br></br> Note: {track} = 'vocals, bass, drums, other'

Spectrogram Example

<p align="center"> <img width="796" alt="image" src="https://github.com/user-attachments/assets/cee048de-e03e-4ec2-92b6-ecb4324ec384"> </p>

License

TS-BSMAMBA2 is licensed under the Apache License 2.0.

Citication

If you use this work in your research or project, please cite the following paper:


@misc{bai2024twostagebandsplitmamba2network,
      title={A Two-Stage Band-Split Mamba-2 Network for Music Separation}, 
      author={Jinglin Bai and Yuan Fang and Jiajie Wang and Xueliang Zhang},
      year={2024},
      eprint={2409.06245},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2409.06245}
}

Contact

For any questions or feedback regarding TS-BSMAMBA2, feel free to reach out to us via email:
bjlin@mail.imu.edu.cn