Awesome
Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identification
International Conference on Computer Vision (ICCV 2023). [Arxiv, PDF, Project]
Feng Liu, Minchul Kim, Ziang Gu, Anil Jain, Xiaoming Liu
Long-Term Person Re-Identification (LT-ReID) has become increasingly crucial in computer vision and biometrics. In this work, we aim to extend LT-ReID beyond pedestrian recognition to include a wider range of real-world human activities while still accounting for cloth-changing scenarios over large time gaps. This setting poses additional challenges due to the geometric misalignment and appearance ambiguity caused by the diversity of human pose and clothing. To address these challenges, we propose a new approach 3DInvarReID for (i) disentangling identity from non-identity components (pose, clothing shape, and texture) of 3D clothed humans, and (ii) reconstructing accurate 3D clothed body shapes and learning discriminative features of naked body shapes for person ReID in a joint manner. To better evaluate our study of LT-ReID, we collect a real-world dataset called CCDA, which contains a wide variety of human activities and clothing changes. Experimentally, we show the superior performance of our approach for person ReID.
Prerequisites
This code is developed with
- Python 3.7
- Pytorch 1.8
- Cuda 11.1
Stage1: Pre-train the Joint Two-Layer Implicit Model
Please refer to pretrain/README for the details.
Stage2: Person Re-Identification
Please refer to matching/README for the details.
The Cloth-Changing and Diverse Activities (CCDA) dataset
Please find the dataest here
Citation
@inproceedings{liu2023learning,
title={Learning clothing and pose invariant 3d shape representation for long-term person re-identification},
author={Liu, Feng and Kim, Minchul and Gu, ZiAng and Jain, Anil and Liu, Xiaoming},
booktitle={ICCV},
year={2023}
}
Acknowledgments
Here are some great resources we benefit from:
- gDNA for 3D clothed human model modeling.
- Simple-CCReID for person re-identification.
License
Contact
For questions feel free to post here or drop an email to - liufeng6@msu.edu