Home

Awesome

Structure-Aware Flow Generation for Human Body Reshaping (CVPR 2022)

Jianqiang Ren, Yuan Yao, Biwen Lei, Miaomiao Cui, Xuansong Xie

DAMO Academy, Alibaba Group, Hangzhou, China

Paper | Supp | Video | More Results

News

(2022-09-28) The pretrained model and code are available now.

Overview

We propose a novel end-to-end structure-aware flow generation framework for human body reshaping(FBBR), which can achieve favorable and controllable results for high-resolution images efficiently. The BR-5K is the first large-scale dataset for body reshaping, it consists of 5,000 high-quality individual portrait photos at 2K resolution collected from Unsplash.

<img src="gif/438.gif" height="300px"/> <img src="gif/285.gif" height="300px"/> <img src="gif/998.gif" height="300px"/>

BR5K Dataset

Considering that the misuse of the dataset may lead to ethical concerns, as recommended by AC, we will review the application to access the datasets. To be able to download the BR5K database, please download, sign the agreement form, and then use your work e-mail(e.g., xx@xx.edu.cn, xx@your_company.com) to send the form to (jianqiang.rjq@alibaba-inc.com).

Getting Started

Install Requriements

Models

Run the Demo

python test.py --config config/test_demo_setting.toml

the results will be in the test_cases_output directory.

Quantitative Evaluaton

In this repository, we take a new pretrained model of openpose and achieve better quantitative performance than reported in our paper.

MethodSSIMPSNRLPIPS
Baseline0.833924.49160.0823
Paper0.835424.79240.0777
This Repository0.839425.58010.0684

Citation

If our work is useful for your research, please consider citing:

@inproceedings{ren2022structure,
title={Structure-Aware Flow Generation for Human Body Reshaping},
author={Ren, Jianqiang and Yao, Yuan and Lei, Biwen and Cui, Miaomiao and Xie, Xuansong},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
pages={7754--7763},
year={2022}
}

Acknowledgement

We express gratitudes to openpose and pytorch-openpose, as we benefit a lot from both their papers and codes.

License

© Alibaba, 2022. For academic and non-commercial use only.