Home

Awesome

Vim-F: Visual State Space Model Benefiting from Learning in the Frequency Domain

Introduction

This project is based on Vim (paper, code) and we appreciate this excellent work. You can simply replace main.py and models_mamba.py with our versions to reimplement our work. Among them, main.py has no substantial modifications, and only the code related to position embedding in the original file has been removed to fit our work.

ImageNet classification

Pre-training

V1

ModelDatasetResolutionTop1Ckpt/Logs
Vim-Ti-F(H)ImgNet 1K224×22476.0ckpt/log
Vim-S-F(H)ImgNet 1K224×22480.5ckpt/log

V2

ModelDatasetResolutionTop1Ckpt/Logs
Vim-Ti-FImgNet 1K224×22476.7ckpt/log
Vim-S-FImgNet 1K224×22480.9retraining