Home

Awesome

GMSR: Gradient-Guided Mamba for Spectral Reconstruction from RGB Images

[Xinying Wang], [Zhixiong Huang], [Sifan Zhang], [Jiawen Zhu], [Paolo Gamba], and [Lin Feng]

GMSR-Net Framework

<img src="./figure/GMSR.png"/>

Spectral Reconstruction

We propose GMSR-Net, the first Mamba framework designed for SR task. We are going to enlarge our model zoo in the future. The support list is as follows:

<details open> <summary><b>Supported algorithms:</b></summary>

Train

1. Created Environment.

2. Data Preprocess.

Before training, you need to split the original datasets into 128*128 by train_data_preprocess and valid_data_preprocess. Then, replace the data location in the file. Finally, you can obtain the running data with:

Getting the prepared train data by run:

python train_data_preprocess.py --data_path './data/Dataset' --patch_size 128 --stride 64 --train_data_path './dataset/2020Train'

Getting the prepared valid data by run:

python valid_data_preprocess.py --data_path './data/Dataset' --valid_data_path './dataset/2020Val'

Training.

python main.py

The data generated during training will be recorded in /results/GMSR.

Test

python test.py

Citation

If you find this code helpful, please kindly cite:

# GMSR-Net
@article{wang2024gmsr,
  title={GMSR: Gradient-Guided Mamba for Spectral Reconstruction from RGB Images},
  author={Wang, Xinying and Huang, Zhixiong and Zhang, Sifan and Zhu, Jiawen and Feng, Lin},
  journal={arXiv preprint arXiv:2405.07777},
  year={2024}
}