Awesome

PELA: Learning Parameter-Efficient Models with Low-Rank Approximation [CVPR 2024]

Code contribution:

Yangyang Guo -- ALBEF
Guangzhi Wang -- DeiT and Swin.

Detailed configuration of each model can be found on each model directory.

<div style="text-align:center"> <img src="./model.jpg" alt="model" style="width: 90%;" /> </div>

Acknowledgement

If you found this repo helpful, please consider cite the following paper:

@inproceedings{pela,
  author       = {Yangyang Guo and Guangzhi Wang and Mohan Kankanhalli},
  title        = {PELA: Learning Parameter-Efficient Models with Low-Rank Approximation},
  booktitle    = {CVPR},
  year         = {2024}
}