Home

Awesome

Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data

Updates

Paper

Model Zoo

Image Classification

Checkpoints available at

SyntaxAccWeight
Mamba2D-S/881.7weight
Mamba2D-B/883.0weight

Video Classification

SyntaxAccWeight
UCF-101 (Scratch)89.6weight
HMDB-51 (Scratch)60.9weight
K40081.9weight

3D Segmentation

SyntaxFeature SizeDiceWeight
Mamba3D-S/163283.1weight
Mamba3D-S+/163283.9weight
Mamba3D-B/163282.7weight
Mamba3D-B/166484.7weight

Environment Setup

pip install causal-conv1d>=1.2.0
git install git+https://github.com/state-spaces/mamba.git

For image classification, mmpretrain is required. For video classification, mmaction is required. Please see offical documentation for installation instructions.

Training

Please see refer to the following instructions for each task:

Image classification Video classification Video classification (K400 Pretraining) 3D segmentation

Citation

@article{li2024mamba,
  title={Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data},
  author={Li, Shufan and Singh, Harkanwar and Grover, Aditya},
  journal={arXiv preprint arXiv:2402.05892},
  year={2024}
}