Awesome

PhysMamba

Codes of paper "PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba" Arxiv Accepted by Chinese Conference on Biometric Recognition (CCBR 2024 Oral)

Set up

Code is based on rPPG-Toolbox

• Environment

conda create -n PhysMamba python=3.8
pip install torch==2.0.0 torchvision==0.15.1 torchaudio==2.0.1 --index-url https://download.pytorch.org/whl/cu118

• Install packages

pip install -r requirements.txt

• Install causal-conv1d

cd causal-conv1d
python setup.py install

• Install Mamba

cd mamba
python setup.py install

Datasets

• MMPD

  • Jiankai Tang, Kequan Chen, Yuntao Wang, Yuanchun Shi, Shwetak Patel, Daniel McDuff, Xin Liu, "MMPD: Multi-Domain Mobile Video Physiology Dataset", IEEE EMBC, 2023

  ---

     data/MMPD/
     |   |-- subject1/
     |       |-- p1_0.mat
     |       |-- p1_1.mat
     |       |...
     |       |-- p1_19.mat
     |   |-- subject2/
     |       |-- p2_0.mat
     |       |-- p2_1.mat
     |       |...
     |...
     |   |-- subjectn/
     |       |-- pn_0.mat
     |       |-- pn_1.mat
     |       |...
  

  ---

• UBFC-rPPG

  • S. Bobbia, R. Macwan, Y. Benezeth, A. Mansouri, J. Dubois, "Unsupervised skin tissue segmentation for remote photoplethysmography", Pattern Recognition Letters, 2017.

  ---

     data/UBFC-rPPG/
     |   |-- subject1/
     |       |-- vid.avi
     |       |-- ground_truth.txt
     |   |-- subject2/
     |       |-- vid.avi
     |       |-- ground_truth.txt
     |...
     |   |-- subjectn/
     |       |-- vid.avi
     |       |-- ground_truth.txt
  

  ---

• PURE

  • Stricker, R., Müller, S., Gross, H.-M.Non-contact "Video-based Pulse Rate Measurement on a Mobile Service Robot" in: Proc. 23st IEEE Int. Symposium on Robot and Human Interactive Communication (Ro-Man 2014), Edinburgh, Scotland, UK, pp. 1056 - 1062, IEEE 2014

  ---

     data/PURE/
     |   |-- 01-01/
     |      |-- 01-01/
     |      |-- 01-01.json
     |   |-- 01-02/
     |      |-- 01-02/
     |      |-- 01-02.json
     |...
     |   |-- ii-jj/
     |      |-- ii-jj/
     |      |-- ii-jj.json
  

  ---

Train

Cross-dataset

• Training on UBFC-rPPG and Test on PURE

1. Modify the configuration file ./configs/train_configs/UBFC-rPPG_UBFC-rPPG_PURE_PHYSMAMBA
2. Run python main.py --config_file ./configs/train_configs/UBFC-rPPG_UBFC-rPPG_PURE_PHYSMAMBA.yaml

• Training on PURE and Test on UBFC-rPPG

1. Modify the configuration file ./configs/train_configs/PURE_PURE_UBFC-rPPG_PHYSMAMBA_BASIC.yaml
2. Run python main.py --config_file ./configs/train_configs/PURE_PURE_UBFC-rPPG_PHYSMAMBA_BASIC.yaml

Intro-dataset on UBFC-rPPG

1. Modify the configuration file ./configs/train_configs/UBFC_INTRO_PHYSMAMBA.yaml
2. Run python main.py --config_file ./configs/train_configs/UBFC_INTRO_PHYSMAMBA.yaml

Citation

@inproceedings{luo2024physmamba,
  title={PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba},
  author={Chaoqi Luo and Yiping Xie and Zitong Yu},
  booktitle={Chinese Conference on Biometric Recognition (CCBR)},
  year={2024}
}