Awesome

Awesome-Mamba-Papers

This repository compiles a list of papers related to Mamba and SSM.

Continual improvements are being made to this repository. If you come across any relevant papers that should be included, please don't hesitate to open an issue or email me with tangyujin0275@gmail.com.

Last update on

News

• Last update on 24.10.12
• Add Papaers accepted by CVPR24, ECCV24, ACM-MM24 with notes(Search the conference name within this repo.)
• SegMamba accepted by MICCAI24!
• Mamba-2, VIM, Caduceus accepted by ICML24

Survey

(Arxiv 24.04.15) State Space Model for New-Generation Network Alternative to Transformers: A Survey Paper Code

(Arxiv 24.04.24) A Survey on Visual Mamba Paper

(Arxiv 24.04.24) Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges Paper Code

(Arxiv 24.04.29) A Survey on Vision Mamba: Models, Applications and Challenges Paper Code

(Arxiv 24.05.07) Vision Mamba: A Comprehensive Survey and Taxonomy Paper Code

(Arxiv 24.06.05) Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis Paper Code

State Space Model (SSM)

(NeurIPS 2020 Spotlight) HiPPO: Recurrent Memory with Optimal Polynomial Projections Paper Code

(ICLR 2022) S4: Efficiently Modeling Long Sequences with Structured State Spaces Paper Code

(ICLR 2023) H3: Hungry Hungry Hippos: Toward Language Modeling with State Space Models Paper Code

(Arxiv 24.05.26) A Unified Implicit Attention Formulation for Gated-Linear Recurrent Sequence Models Paper Code

(Arxiv 24.05.27) The Expressive Capacity of State Space Models: A Formal Language Perspective Paper Code

(Arxiv 24.05.31, ICML24, Mamba-2) Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality Paper Code

(Arxiv 24.06.04) GrootVL: Tree Topology is All You Need in State Space Model Paper Code

(Arxiv 24.06.12) An Empirical Study of Mamba-based Language Models Paper

(Arxiv 24.10.04) S7: Selective and Simplified State Space Layers for Sequence Modeling Paper

Mamba

(Arxiv 23.12.01) Mamba: Linear-Time Sequence Modeling with Selective State Spaces Paper Code

(Arxiv 24.01.08) MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts Paper

(Arxiv 24.01.24) MambaByte: Token-free Selective State Space Model Paper Code

(Arxiv 24.01.31) LOCOST: State-Space Models for Long Document Abstractive Summarization Paper Code

(Arxiv 24.02.01) BlackMamba: Mixture of Experts for State-Space Models Paper Code

(Arxiv 24.02.06) Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks Paper Code

(Arxiv 24.02.08->ECCV24) Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data Paper Code

(Arxiv 24.02.15) Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling Paper Code

(Arxiv 24.02.19) Pan-Mamba: Effective pan-sharpening with State Space Model Paper Code

(CVPR24) State Space Models for Event Cameras Paper Code

(Arxiv 24.02.26) DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models Paper Code

(Arxiv 24.03.03) The Hidden Attention of Mamba Models Paper Code

(Arxiv 24.03.08) MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models Paper

(Arxiv 24.03.11) MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathology Paper Code

(Arxiv 24.03.12) Motion Mamba: Efficient and Long Sequence Motion Generation with Hierarchical and Bidirectional Selective SSM Paper Code

(Arxiv 24.03.13) ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes Paper Code

(Arxiv 24.03.26) State Space Models as Foundation Models: A Control Theoretic Overview Paper

(Arxiv 24.03.28) Jamba: A Hybrid Transformer-Mamba Language Model Paper Code

(Arxiv 24.03.29) HARMamba: Efficient Wearable Sensor Human Activity Recognition Based on Bidirectional Selective SSM Paper

(Arxiv 24.04.07) VMambaMorph: a Visual Mamba-based Framework with Cross-Scan Module for Deformable 3D Image Registration Paper Code

(Arxiv 24.04.12) SpectralMamba: Efficient Mamba for Hyperspectral Image Classification Paper Code

(Arxiv 24.05.13) MambaOut: Do We Really Need Mamba for Vision? Paper Code

(Arxiv 24.05.19) NetMamba: Efficient Network Traffic Classification via Pre-training Unidirectional Mamba Paper Code

(Arxiv 24.05.23) EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Records Paper

(Arxiv 24.05.26) Mamba4KT:An Efficient and Effective Mamba-based Knowledge Tracing Model Paper

(Arxiv 24.05.26) Zamba: A Compact 7B SSM Hybrid Model Paper

(Arxiv 24.05.30) MSSC-BiMamba: Multimodal Sleep Stage Classification and Early Diagnosis of Sleep Disorders with Bidirectional Mamba Paper

Language/Sequence Modeling

(Arxiv 24.03.05, ICML24) Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling Paper Code

(Arxiv 24.06.11) Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling Paper

Vision

(Arxiv 24.01.17) Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model Paper Code

(Arxiv 24.01.18) VMamba: Visual State Space Model Paper Code

(Arxiv 24.02.05) Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining Paper Code

(Arxiv 24.02.06) U-shaped Vision Mamba for Single Image Dehazing Paper Code

(Arxiv 24.02.23) MambaIR: A Simple Baseline for Image Restoration with State-Space Model Paper Code

(Arxiv 24.02.23->CVPR24) State Space Models for Event Cameras Paper Code

(Arxiv 24.02.24) Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with Deep Residual Learning Paper Code

(Arxiv 24.03.04) MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detection Paper Code

(Arxiv 24.03.15) EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba Paper Code

(Arxiv 24.03.15) On the low-shot transferability of [V]-Mamba Paper

(Arxiv 24.03.26) PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition Paper Code

(Arxiv 24.03.26) Integrating Mamba Sequence Model and Hierarchical Upsampling Network for Accurate Semantic Segmentation of Multiple Sclerosis Legion Paper

(Arxiv 24.03.27) Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction Paper

(Arxiv 24.03.27) ReMamber: Referring Image Segmentation with Mamba Twister Paper

(Arxiv 24.03.28) RSMamba: Remote Sensing Image Classification with State Space Model Paper Code

(Arxiv 24.04.02) Samba: Semantic Segmentation of Remotely Sensed Images with State Space Model Paper Code

(Arxiv 24.04.03) RS3Mamba: Visual State Space Model for Remote Sensing Images Semantic Segmentation Paper Code

(Arxiv 24.04.03) RS-Mamba for Large Remote Sensing Image Dense Prediction Paper Code

(Arxiv 24.04.04) ChangeMamba: Remote Sensing Change Detection with Spatio-Temporal State Space Model Paper Code

(Arxiv 24.04.05) Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation Paper Code

(Arxiv 24.04.09) MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection Paper Code

(Arxiv 24.04.15) FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining Paper

(Arxiv 24.04.16) Exploring Learning-based Motion Models in Multi-Object Tracking Paper

(Arxiv 24.04.17) CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration Paper

(Arxiv 24.04.17) Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion Paper

(Arxiv 24.04.20) Vim4Path: Self-Supervised Vision Mamba for Histopathology Images Paper Code

(Arxiv 24.04.28) Mamba-FETrack: Frame-Event Tracking via State Space Model Paper Code

(Arxiv 24.04.28) S2Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification Paper Code

(Arxiv 24.04.29) Spectral-Spatial Mamba for Hyperspectral Image Classification Paper

(Arxiv 24.04.29) RSCaMa: Remote Sensing Image Change Captioning with State Space Model Paper Code

(Arxiv 24.05.02) SOAR: Advancements in Small Body Object Detection for Aerial Imagery Using State Space Models and Programmable Gradients Paper Code

(Arxiv 24.05.02) SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising Paper Code

(Arxiv 24.05.05) DVMSR: Distillated Vision Mamba for Efficient Super-Resolution Paper Code

(Arxiv 24.05.05) AC-MAMBASEG: An adaptive convolution and Mamba-based architecture for enhanced skin lesion segmentation Paper Code

(Arxiv 24.05.06) Retinexmamba: Retinex-based Mamba for Low-light Image Enhancement Paper Code

(Arxiv 24.05.07) VMambaCC: A Visual State Space Model for Crowd Counting Paper

(Arxiv 24.05.08) Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution Paper

(Arxiv 24.05.09) Rethinking Efficient and Effective Point-based Networks for Event Camera Classification and Regression: EventMamba Paper

(Arxiv 24.05.13) GMSR:Gradient-Guided Mamba for Spectral Reconstruction from RGB Images Paper

(Arxiv 24.05.13) OverlapMamba: Novel Shift State Space Model for LiDAR-based Place Recognition Paper

(Arxiv 24.05.14) Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Study Paper

(Arxiv 24.05.16) IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Model Paper Code

(Arxiv 24.05.16) RSDehamba: Lightweight Vision Mamba for Remote Sensing Satellite Image Dehazing Paper

(Arxiv 24.05.17) CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation Paper Code

(Arxiv 24.05.16) IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Model Paper Code

(Arxiv 24.05.20) Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classification Paper Code

(Arxiv 24.05.21) 3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification Paper

(Arxiv 24.05.23) Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model Paper Code

(Arxiv 24.05.23) Scalable Visual State Space Model with Fractal Scanning Paper

(Arxiv 24.05.23) Mamba-R: Vision Mamba ALSO Needs Registers Paper Code

(Arxiv 24.05.24) MUCM-Net: A Mamba Powered UCM-Net for Skin Lesion Segmentation Paper

(Arxiv 24.05.26) Demystify Mamba in Vision: A Linear Attention Perspective Paper Code

(Arxiv 24.05.29) Vim-F: Visual State Space Model Benefiting from Learning in the Frequency Domain Paper Code

(Arxiv 24.05.29) FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining Paper

(Arxiv 24.06.06) MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation Paper

(Arxiv 24.06.09) HDMba: Hyperspectral Remote Sensing Imagery Dehazing with State Space Model Paper

(Arxiv 24.06.09) Mamba YOLO: SSMs-Based YOLO For Object Detection Paper

(Arxiv 24.06.09) MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mamba Paper Code

(Arxiv 24.06.11) DualMamba: A Lightweight Spectral-Spatial Mamba-Convolution Network for Hyperspectral Image Classification Paper

(Arxiv 24.06.11) Autoregressive Pretraining with Mamba in Vision Paper Code

Video

(Arxiv 24.01.25) Vivim: a Video Vision Mamba for Medical Video Object Segmentation Paper Code

(Arxiv 24.03.11) VideoMamba: State Space Model for Efficient Video Understanding Paper Code

(Arxiv 24.04.01) SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Grounding Paper

(Arxiv 24.04.09) RhythmMamba: Fast Remote Physiological Measurement with Arbitrary Length Videos Paper Code

(Arxiv 24.04.11) Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in Videos Paper

(Arxiv 24.05.05) Matten: Video Generation with Mamba-Attention Paper

(Arxiv 24.05.23) MAMBA4D: Efficient Long-Sequence Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models Paper

(Arxiv 24.05.24) Scaling Diffusion Mamba with Bidirectional SSMs for Efficient Image and Video Generation Paper

(Arxiv 24.05.30) DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark Paper Code

(Arxiv 24.07.31->ACM MM24) RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining Paper Code

Spatiotemporal

(CVPR24 Precognition Workshop) VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting Paper Code

(Arxiv 24.04.20) ST-Mamba: Spatial-Temporal Selective State Space Model for Traffic Flow Prediction Paper

(Arxiv 24.04.24) ST-MambaSync: The Confluence of Mamba Structure and Spatio-Temporal Transformers for Precipitous Traffic Prediction Paper

Medical

(Arxiv 24.01.09) U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation Paper Code

(Arxiv 24.01.24, MICCAI24) SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation Paper Code

(Arxiv 24.01.25) Vivim: a Video Vision Mamba for Medical Video Object Segmentation Paper Code

(Arxiv 24.01.25) MambaMorph: a Mamba-based Backbone with Contrastive Feature Learning for Deformable MR-CT Registration Paper Code

(Arxiv 24.02.04) VM-UNet: Vision Mamba UNet for Medical Image Segmentation Paper Code

(Arxiv 24.02.05) nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with State Space Model Paper Code

(Arxiv 24.02.09) FD-Vision Mamba for Endoscopic Exposure Correction Paper

(Arxiv 24.02.16) Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation Paper Code

(Arxiv 24.03.06) MedMamba: Vision Mamba for Medical Image Classification Paper Code

(Arxiv 24.03.08) LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation Paper Code

(Arxiv 24.03.12) Large Window-based Mamba UNet for Medical Image Segmentation: Beyond Convolution and Self-attention Paper Code

(Arxiv 24.03.20) H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentation Paper Code

(Arxiv 24.03.20) ProMamba: Prompt-Mamba for polyp segmentation Paper

(Arxiv 24.03.25) CMViM: Contrastive Masked Vim Autoencoder for 3D Multi-modal Representation Learning for AD classification Paper

(Arxiv 24.03.26) Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation Paper

(Arxiv 24.03.29) UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation Paper Code

(Arxiv 24.04.01) T-Mamba: Frequency-Enhanced Gated Long-Range Dependency for Tooth 3D CBCT Segmentation Paper

(MIDL 2024) ViM-UNet: Vision Mamba for Biomedical Segmentation Paper Code

(Arxiv 24.05.08) HC-Mamba: Vision MAMBA with Hybrid Convolutional Techniques for Medical Image Segmentation Paper

(Arxiv 24.05.08) VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis Paper

(Arxiv 24.05.22) I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling Paper

(Arxiv 24.05.25) UU-Mamba: Uncertainty-aware U-Mamba for Cardiac Image Segmentation Paper

(Arxiv 24.05.27) Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba Paper

(Arxiv 24.05.28) Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mamba Paper

(Arxiv 24.06.09) Vision Mamba: Cutting-Edge Classification of Alzheimer's Disease with 3D MRI Scans Paper

(Arxiv 24.06.09) Convolution and Attention-Free Mamba-based Cardiac Image Segmentation Paper

Time Series

(Arxiv 24.03.14) TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting Paper Code

(Arxiv 24.03.17) Is Mamba Effective for Time Series Forecasting? Paper Code

(Arxiv 24.03.22) SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series Paper Code

(Arxiv 24.04.23) Integrating Mamba and Transformer for Long-Short Range Time Series Forecasting Paper Code

(Arxiv 24.04.24) Bi-Mamba+: Bidirectional Mamba for Time Series Forecasting Paper

(Arxiv 24.05.11) DTMamba : Dual Twin Mamba for Time Series Forecasting Paper

(Arxiv 24.05.25) Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting Paper

(Arxiv 24.05.26) MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting Paper

(Arxiv 24.06.06) Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Models Paper

(Arxiv 24.06.06) TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification Paper

(Arxiv 24.06.08) C-Mamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting Paper

Speech/Audio

(Arxiv 24.03.12) Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers Paper code

(Arxiv 24.03.27) Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation Paper Code

(Arxiv 24.04.02) SPMamba: State-space model is all you need in speech separation Paper code

(Arxiv 24.05.02) TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms Paper

(Arxiv 24.05.10) An Investigation of Incorporating Mamba for Speech Enhancement Paper

(Arxiv 24.05.18) MAMCA -- Optimal on Accuracy and Efficiency for Automatic Modulation Classification with Extended Signal Length Paper code

(Arxiv 24.05.20) SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model Paper code

(Arxiv 24.05.21) Mamba in Speech: Towards an Alternative to Self-Attention Paper

(Arxiv 24.06.04, INTERSPEECH 2024) Audio Mamba: Pretrained Audio State Space Model For Audio Tagging Paper Code

(Arxiv 24.06.05) Audio Mamba: Bidirectional State Space Model for Audio Representation Learning Paper Code

(Arxiv 24.06.10) RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection Paper

Graph

(Arxiv 24.02.01) Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spaces Paper Code

(Arxiv 24.02.13) Graph Mamba: Towards Learning on Graphs with State Space Models Paper Code

(Arxiv 24.03.19) STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model Paper Code

(Arxiv 24.06.05) Combining Graph Neural Network and Mamba to Capture Local and Global Tissue Spatial Relationships in Whole Slide Images Paper Code

(Arxiv 24.09.26) Mamba Meets Financial Markets: A Graph-Mamba Approach for Stock Price Prediction Paper Code

Point Cloud

(Arxiv 24.02.16) PointMamba: A Simple State Space Model for Point Cloud Analysis Paper Code

(Arxiv 24.03.01) Point Could Mamba: Point Cloud Learning via State Space Model Paper Code

(Arxiv 24.04.08) 3DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering Paper

(Arxiv 24.04.10) 3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion Paper

(Arxiv 24.04.23) Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model Paper

(Arxiv 24.05.24) PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysis Paper Code

(Arxiv 24.06.10) PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis Paper

Recommendation

(Arxiv 24.03.06) Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models Paper Code

(Arxiv 24.03.25) Uncovering Selective State Space Model's Capabilities in Lifelong Sequential Recommendation Paper Code

(Arxiv 24.06.04) Mamba as Decision Maker: Exploring Multi-scale Sequence Modeling in Offline Reinforcement Learning Paper Code

Multimodal

(Arxiv 24.03.20) VL-Mamba: Exploring State Space Models for Multimodal Learning Paper Code

(Arxiv 24.03.22) Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference Paper Code

(Arxiv 24.04.09) 3DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering Paper

(Arxiv 24.04.11) FusionMamba: Efficient Image Fusion with State Space Model Paper

(Arxiv 24.04.11) SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction Paper

(Arxiv 24.04.12) MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion Paper

(Arxiv 24.04.14) Fusion-Mamba for Cross-modality Object Detection Paper

(Arxiv 24.04.15) FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mamba Paper Code

(Arxiv 24.04.25) CFMW: Cross-modality Fusion Mamba for Multispectral Object Detection under Adverse Weather Conditions Paper Code

(Arxiv 24.04.27) Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusion Paper

(Arxiv 24.04.30) CLIP-Mamba: CLIP Pretrained Mamba Models with OOD and Hessian Evaluation Paper Code

(Arxiv 24.05.24) Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models Paper Code

(Arxiv 24.05.28) Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Model Paper

Reinforcement Learning

(Arxiv 24.03.29) Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spaces Paper

(Arxiv 24.05.20) Is Mamba Compatible with Trajectory Optimization in Offline Reinforcement Learning? Paper

(Arxiv 24.05.31) Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling? Paper

(Arxiv 24.06.04) EchoMamba4Rec: Harmonizing Bidirectional State Space Models with Spectral Filtering for Advanced Sequential Recommendation Paper

(Arxiv 24.06.08) Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL Paper

(Arxiv 24.10.11) Drama: Mamba-Enabled Model-Based Reinforcement Learning Is Sample and Parameter Efficient Paper Code

Diffusion

(Arxiv 24.03.21) ZigMa: Zigzag Mamba Diffusion Model Paper Code

(Arxiv 24.05.05) SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion Paper

(Arxiv 24.05.08) VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis Paper

(Arxiv 24.05.23) DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis Paper Code

(Arxiv 24.05.24) Scaling Diffusion Mamba with Bidirectional SSMs for Efficient Image and Video Generation Paper

(Arxiv 24.05.28) DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention Paper Code

(Arxiv 24.06.03) Dimba: Transformer-Mamba Diffusion Models Paper Code

(Arxiv 24.06.07) Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs Paper Code

(Arxiv 24.09.05) MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videos Paper

Embodied AI

(Arxiv 24.06.06) RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation Paper Code

Healthcare/Drug discovery/Bio NLP

(Arxiv 24.07.30) MambaCapsule: Towards Transparent Cardiac Disease Diagnosis with Electrocardiography Using Mamba Capsule Network Paper

(Arxiv 24.08.15) BioMamba: A Pre-trained Biomedical Language Representation Model Leveraging Mamba Paper

(Arxiv 24.08.11) SMILES-Mamba: Chemical Mamba Foundation Models for Drug ADMET Prediction Paper

Interpretability

(Arxiv 24.06.11) MambaLRP: Explaining Selective State Space Sequence Models Paper Code

Other Useful Sources

Mamba_State_Space_Model_Paper_List

Awesome State-Space Resources for ML

Awesome-state-space-models

Video-of-HiPPO

Video-of-Mamba-and-S4-Explained

Mamba-Notes

Annotated-Mamba

A Visual Guide to Mamba and State Space Models

Citation

If you find this repository useful, please consider citing our paper:

@inproceedings{tang2024vmrnn,
      title={VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting}, 
      author={Yujin Tang and Peijie Dong and Zhenheng Tang and Xiaowen Chu and Junwei Liang},
    booktitle={CVPRW},
      year={2024},
}